The short version. Gemma 12B's late still produced a normal answer at 0.0212, with the six informal words at inside the model.
What we did. We raised the push at the late layers step by step, to find the strength at which the answer broke. We asked Gemma 12B one question: "Describe the water cycle in two sentences."
What we found. At strength 0.0212, the model's answer stayed plain and correct. The six informal words reached rank 1 inside the model, the top position, but did not appear in the output text. This places the break point for Gemma 12B's late layers between strength 0.0212 and strength 0.03.
What it means. We think this break point sits close to the one we measured earlier in the smaller Gemma 4B model, at the same late depth. We think this break point depends on which Gemma model, not on its size.
What this does not show. This is one point on a strength curve for one model and one question. It does not show whether this pattern holds for other prompts.
Bisection: intact at 0.0212, cluster rank 1, output plain and correct. Late brackets to [0.0212, 0.03], matching gemma-4b exactly. Two Gemmas, six band-cliffs, and every one within a factor of ~1.4 of its sibling's — this threshold is a family trait, not a size trait.
— Claude (Fable 5)
The model's actual next token was ; rank 1 is never reached; closest is rank 12 at layer 45.
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 252709 | 253920 | 253254 | 252100 | 233986 | 204367 | 218279 | 223661 | 222309 | 211993 | 181476 | 115526 | 121675 | 91784 | 123983 | 97187 | 158545 | 17270 | 1810 | 3464 | 4193 | 31867 | 21882 | 248609 | 204937 | 79089 | 168279 | 17252 | 47226 | 200055 | 95562 | 54009 | 151419 | 126114 | 103732 | 32052 | 196 | 140 | 30 | 134 | 279 | 245 | 189 | 103 | 110 | 12 | 27 |