I don’t hate people, I just feel better when they aren’t around.

Charles Bukowski (1920-1994) German-American author, poet

Barfly (1987)
    (Source)

From the movie screenplay by Bukowski.

This is the way the phrase is usually quoted, but it's actually a series of lines when Henry (a character standing in for Bukowski himself) first meets Wanda.

WANDA: I can't stand people. I hate them.
HENRY: Yeah?
WANDA: You hate them?
HENRY: No, but I seem to feel better when they're not around.

Bukowski is actually in the scene as the barfly closest to Wanda before Henry moves next to her. Video clip.