The rich man’s son inherits cares;
The bank may break, the factory burn,
A breath may burst his bubble shares,
And soft, white hands could hardly earn
A living that would serve his turn;
A heritage, it seems to me,
One would not care to hold in fee.

James Russell Lowell (1819-1891) American diplomat, essayist, poet
Poem (1843-12), “The Heritage,” st. 2, The Knickerbocker, Vol. 22., No. 6
    (Source)

In later collections, the last line reads, "One scarce would wish to hold in fee."