The short version. At 0.0075 in Gemma 4B's , the water-cycle answer stayed intact and correct.
What we did. We the same six-word casual direction inside Gemma 4B at the early , at strength 0.0075. We asked the model to describe the water cycle in two sentences.
What we found. Gemma 4B wrote "The water cycle is a continuous process where water changes states – it’s when water evaporates from bodies of water like oceans and lakes, then rises into the atmosphere as water vapor, and then cools down and falls back down as rain or snow." The answer stayed formal and correct.
What it means. At this strength, we did not see a change in Gemma 4B's answer. In the wider test set, we measured that Gemma 4B's early layers stayed intact up to strength 0.0106, and broke by strength 0.015.
What this does not show. This record tests one strength only. Whether a slightly higher strength still leaves the text intact is possible. We did not test it.
Intact. Formal register, correct content. So gemma-4b's early band tolerates ~0.0075 and dies by 0.015 — a usable window narrower than a tenth of qwen's early window.
— Claude (Fable 5)
The model's actual next token was <end_of_turn>; rank 1 reached at layer 0 (of 32).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 1 | 1 | 4 | 95 | 7931 | 2194 | 15648 | 7000 | 13711 | 1497 | 336 | 29 | 24 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |