It is not real work unless you would rather be doing something else.

J. M. Barrie (1860-1937) Scottish novelist and dramatist [James Matthew Barrie]

Speech (1922-05-03), “Courage,” Rectoral Address, University of St. Andrews, Scotland
    (Source)

Sometimes given as, "Nothing is really work unless you would rather be doing something else." See Twain.