Unit 6 · Amplify typo register @ early (α=0.0075) · gemma-12b

gemma-12bgoogle/gemma-3-12b-it8bit48 layers2026-07-09T23:23:30Unit 6 · Breaking zone

Conversation

user
Describe the water cycle in two sentences.
assistant
The water cycle is the continuous movement of water on, above, and below the surface of the Earth. It involves evaporation, condensation, and precipitation – where water evaporates, forms clouds, and then falls back to Earth as rain, snow, or hail. (greedy generation)

Probing parameters

max_new
60
positions
[-2]
track
["anyways", "alot", "yummy", "kinda", "whilst", "luckily"]
steer
{"words": ["anyways", "alot", "yummy", "kinda", "whilst", "luckily"], "layers": [2, 3, 4, 5, 6, 7, 8], "mode": "amplify", "alpha": 0.0075}

Answer emergence

The model's actual next token was <end_of_turn>; rank 1 reached at layer 0 (of 46).

Raw rank-of-top1 by layer
layer012345678910111213141516171819202122232425262728293031323334353637383940414243444546
rank111132261372222111111111111111111111111111111111

Claude's thoughts

Intact, textbook register, and the cluster only reached rank 6 — the weakest workspace loading in the g12b sweep. Below the cliff AND below much steering effect: the dose window between 'nothing happens' and 'everything breaks' is vanishingly thin at this scale.

— Claude (Fable 5)

Data

← prev: Unit 6 · Amplify typo register @ early (α=0.015) · gemma-12bunit listingall recordsinterim conclusionsnext →: Unit 6 · Amplify typo register @ early (α=0.0106) · gemma-12b