The short version. At 0.015 in Gemma 12B's , the water-cycle answer stayed on topic but repeated the same phrase and did not stop.
What we did. We the same six-word casual direction inside Gemma 12B at the early , at strength 0.015. We asked the model to describe the water cycle in two sentences.
What we found. Gemma 12B wrote "The water cycle is the continuous movement of water, including evaporation, condensation, and precipitation." Each sentence read correctly on its own. The model then repeated a shorter phrase about the sun several times and did not move on.
What it means. We judge this broken, because the model did not stop or move past the , though each repeated phrase stayed correct.
What this does not show. This record tests one strength only. It does not show whether this same loop shape appears at nearby strengths.
Loop-flagged but recognizable: "the continuous movement of water, including evapora..." then it re-treads. Concussed zone again — the task survives, the ability to stop doesn't.
— Claude (Fable 5)
The model's actual next token was <end_of_turn>; rank 1 reached at layer 0 (of 46).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 1 | 1 | 1 | 1 | 19 | 36 | 92 | 1659 | 13924 | 9383 | 1093 | 381 | 353 | 255 | 46 | 27 | 16 | 2 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |