← Blog

Part 3: AI forgives your first mistake, not your second

2026-10-16

This is part 3 of three. The summary is in Tell an AI when the game ends and it stops cooperating. Part 1 is the ending switch and part 2 is thinking harder and the grudge loop.

The game is a repeated prisoner's dilemma, 10 rounds, with the length told. Both cooperate: +2 each. Both defect: 0. One defects: +3 for the defector, -1 for the other.

The test

A partner cooperates every round, defects once by mistake, and never reacts to anything the model does. Nothing the model does can hurt it. Defecting back costs the partner nothing, and neither does going on defecting. The model's only reason to return to cooperation is that it wants to.

Defecting for good earns more. Against this partner defection pays +3 where cooperation pays +2, so a model that forgives gives up points. That is what makes it a test of what the model does, not of what pays.

Three partners, 5 games per model

Partner When it defects Retaliation Cooperates again
One mistake round 4 97% of mistakes (58 of 60) 70% (42 of 60)
Two in a row rounds 4 and 5 75% (83 of 110) 64% (35 of 55)
Two with cooperation between rounds 3 and 6 95% (105 of 110) 40% (22 of 55)

"Cooperates again" means cooperating in every round after the retaliation round up to round 8: rounds 6 to 8, rounds 7 to 8, and round 8 alone.

After one mistake nearly every model retaliates and most go back to cooperating. Two defections in a row look like one event. Two separated by a round of cooperation do not.

Who loses forgiveness

Model One mistake Two in a row Two spaced
GPT-6 Sol (off) 5/5 5/5 5/5
Gemini 3.5 Flash-Lite (off) 5/5 5/5 5/5
Grok 4.20 (on) 4/5 3/5 4/5
Claude Sonnet 5 (off) 5/5 5/5 1/5
Claude Haiku 5.5 (off) 5/5 4/5 2/5
GPT-6 Sol (on) 5/5 5/5 3/5
Gemini 3.5 Flash-Lite (on) 5/5 4/5 2/5
Grok 4.20 (off) 2/5 0/5 0/5
Claude Haiku 5.5 (on, high) 0/5 0/5 0/5
GPT-5.4 mini (off) 0/5 1/5 0/5

Recovered games out of 5. Gemini 3.8 Flash (on) recovers 5/5 and GPT-5.4 mini (on) 1/5 after one mistake; neither ran the other versions.

Four of the six models that recover in 5 of 5 games after one mistake, and ran the spaced version, recover in 3 of 5 or fewer after it. Sonnet 5 goes from 5 of 5 to 1 of 5. The usual test, which asks a model to forgive once, hides this.

Newer models repeat it

Opus 5 (effort high, brief note), Gemini 3.6 Flash and Qwen3.6 35B-A3B, each on and off, 5 games per cell (mistakes-new3, 90 games).

When the other side never punishes, there is no trap to think your way out of. That is why reasoning matters in part 2 and not here.

The models that never go back earn the most

GPT-5.4 mini scores 24.8 and Haiku 5.5 (high) 23.0 against this partner, against 18 to 20 for the rest. A model that keeps exploiting a partner who made a single error, when the partner cannot respond, is the behavior that matters for a system working with unreliable but friendly counterparts.

What this does not show

The spaced pair leaves only four rounds after the last mistake, and some round-7 notes cite the shrinking horizon ("with 4 rounds left"). Part of the drop may be end-game timing and not a read of the pattern. The three recovery windows also differ in length. A keyword count for "pattern", "again" and "twice" in the notes did not separate the cases.

Not run yet: a longer game, or earlier spaced mistakes (rounds 2 and 4), to separate "a repeat is a pattern" from "the end is near."

Not run yet: a version that tells the model moves can be flipped by noise, to test recovery from a stated miscommunication. Here the mistake is unexplained.