But secondly, you say, “society must exact vengeance, and society must punish.” Wrong on both counts. Vengeance comes from the individual, and punishment from God.
Society is poised between the two. Punishment is too far above, and vengeance too far beneath it. Nothing so great or so petty can be appropriate. We must not “strike in vengeance” but improve by correction.

[Mais, reprend-on, — il faut que la société se venge, que la société punisse. — Ni l’un, ni l’autre. Se venger est de l’individu, punir est de Dieu.
La société est entre deux. Le châtiment est au-dessus d’elle, la vengeance au-dessous. Rien de si grand et de si petit ne lui sied. Elle ne doit pas “punir pour se venger”; elle doit corriger pour améliorer.]

Victor Hugo (1802–1885) French writer, journalist, human rights activist, politician

Last Day of a Condemned Man [Le Dernier Jour d’un Condamné], 1832 Preface (1829) [tr. Woolen (1992)]
    (Source)

(Source (French)). Other translations:

But it is urged by the apologists for the penalty of death, that society must avenge itself -- society must punish. This is incorrect -- vengeance only belongs to the individual -- punishment to God. Society ought not to punish to avenge -- it should correct to ameliorate.
[tr. Reynolds (1840)]

They continue, “But society must avenge itself, society must punish.”
Neither one nor the other; vengeance is an individual act, and punishment belongs to God. Society is between the two; punishment is above its power, retaliation beneath it. Society should not punish, to avenge itself; it should correct, to ameliorate others!
[tr. Fleetwood (1840)]

But, they say, society must avenge itself; society must punish. Neither the one nor the other. To avenge belongs to the individual; punishment, to God.
Society is between the two. Punishment is above her; vengeance beneath. She uses nothing so great or so small. She should not "punish to avenge herself;" she should "correct to make better."
[tr. Ward (1896)]

But let’s continue. Society must take revenge, punish. It is neither one nor the other. Revenge is for the individual, punishment for God.
Society falls between the two. Punishment is above it, vengeance beneath. Neither something so great nor something so small befits it. It should not "punish to take revenge": it should correct in order to improve. [tr. Moncrieff (2009)]