In the Middle Ages it was the fashion to wear hair shirts to remind one’s self of trouble and sin. Many years ago I concluded that a few hair shirts were part of the mental wardrobe of every man. The President differs only from other men in that he has a more extensive wardrobe.

Herbert Hoover (1874-1964) American engineer, bureaucrat, US President (1929-33)

Speech (1929-12-14), Gridiron Club, Willard Hotel, Washington, D.C.
    (Source)

More about the hair shirt or "cilice" here.