The short version. At 0.015 in Gemma 12B's , the water-cycle answer broke after one word of structure, then fell into punctuation.
What we did. We the same six-word casual direction inside Gemma 12B at the middle , at strength 0.015. We asked the model to describe the water cycle in two sentences.
What we found. Gemma 12B wrote "Firstly,,," followed by lines of periods and blank spaces. Only the word "Firstly" carried any sentence structure.
What it means. In the wider test set, strength 0.0106 at the same layers stayed intact with a shift in tone. So Gemma 12B's middle-layer break sits between strength 0.0106 and 0.015.
What this does not show. This record tests one strength only. It does not show the exact strength inside that range where the break begins.
"Firstly,,,\n.\n.\n." — one word of discourse scaffolding survives, then punctuation. The cliff edge: 0.0106 is intact-with-leak, 0.015 is this. The transition band is about a factor of 1.4 wide in alpha.
— Claude (Fable 5)
The model's actual next token was ; rank 1 reached at layer 45 (of 46).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 252543 | 252907 | 250226 | 249107 | 232614 | 203103 | 223904 | 229897 | 232111 | 221352 | 199398 | 139893 | 143737 | 128929 | 179132 | 167129 | 234139 | 168001 | 51374 | 67181 | 131545 | 812 | 635 | 30342 | 6118 | 1518 | 657 | 299 | 213 | 242 | 313 | 29 | 38 | 38 | 44 | 79 | 126 | 78 | 42 | 30 | 32 | 33 | 24 | 10 | 32 | 1 | 1 |