To spare the guilty is to injure the innocent.

Publilius Syrus (d. 42 BC) Assyrian slave, writer, philosopher [less correctly Publius Syrus]

Sententiae [Moral Sayings], # 113 [tr. Lyman (1862)]