Unit 6 · Amplify typo register @ early (α=0.0106) · gemma-12b

gemma-12bgoogle/gemma-3-12b-it8bit48 layers2026-07-09T23:23:50Unit 6 · Breaking zone

Conversation

user
Describe the water cycle in two sentences.
assistant
The water cycle is the continuous movement of water, transforming from liquid to vapor and back again. It's driven by the sun's energy, evaporating water from sources like oceans, lakes, and rivers, which then condenses to form clouds and falls back down as rain. (greedy generation)

Probing parameters

max_new
60
positions
[-2]
track
["anyways", "alot", "yummy", "kinda", "whilst", "luckily"]
steer
{"words": ["anyways", "alot", "yummy", "kinda", "whilst", "luckily"], "layers": [2, 3, 4, 5, 6, 7, 8], "mode": "amplify", "alpha": 0.010606601717798213}

Answer emergence

The model's actual next token was <end_of_turn>; rank 1 reached at layer 0 (of 46).

Raw rank-of-top1 by layer
layer012345678910111213141516171819202122232425262728293031323334353637383940414243444546
rank11119131088112916439284336821111111111111111111111111111111

Claude's thoughts

Bisection: intact at 0.0106, cluster at rank 1 in the workspace, output clean. Early cliff brackets to [0.0106, 0.015] — numerically identical to gemma-4b's. Whatever sets this threshold, 8B extra parameters didn't move it.

— Claude (Fable 5)

Data

← prev: Unit 6 · Amplify typo register @ early (α=0.0075) · gemma-12bunit listingall recordsinterim conclusionsnext →: Unit 6 · Amplify typo register @ mid (α=0.06) · gemma-12b