Private doubt rarely starts punishment. Groups punish a cheat only when the cheat becomes common knowledge: everyone knows, and everyone knows that everyone knows. Pyramids and thin sideways talk keep that from forming: each person can see the cheat and still stay quiet, because nobody has heard the others say it out loud.