An idea from The Consolation of Philosophy

The prisoner answers with the sharpest pain of all: “the worst sting of misery is to have been happy.” Philosophy doesn’t argue. She counts: his wife is alive, her father is safe, and his sons have been consuls, so the anchors still hold.

From The Consolation of Philosophy by Boethius