No man is justified in doing evil on the ground of expediency. He is bound to do all the good possible. Yet he must consider the question of expediency, in order that he may do all the good possible, for otherwise he will do none.

Theodore Roosevelt (1858–1919) American politician, statesman, conservationist, writer, US President (1901–1909)

Essay (1900-06), “Latitude and Longitude Among Reformers,” The Century Magazine, Vol. 60, No. 2
    (Source)

Collected in Roosevelt, The Strenuous Life: Essays and Addresses (1902).