It is not real work unless you would rather be doing something else.

J. M. Barrie (1860-1937) Scottish novelist and dramatist [James Matthew Barrie]

“Courage,” Rectoral Address, University of St. Andrews, Scotland (1922-05-03)
    (Source)

Sometimes given as, "Nothing is really work unless you would rather be doing something else." See Twain.