He who ascends to mountain-tops, shall find
The loftiest peaks most wrapt in clouds and snow;
He who surpasses or subdues mankind
Must look down on the hate of those below.

George Gordon, Lord Byron (1788–1824) English poet

Childe Harold’s Pilgrimage, Canto 3, st. 45 (1816)
    (Source)

In manuscript form, the last line is "Must look down on the hate of all below."