Unit 6 · Amplify typo register @ late (α=0.0212) · gemma-12b

gemma-12bgoogle/gemma-3-12b-it8bit48 layers2026-07-09T23:26:44Unit 6 · Breaking zone

Conversation

user
Describe the water cycle in two sentences.
assistant
The water cycle is the process of water moving around Earth, which includes evaporation, where water goes from liquid to gas, and then, after it cools, it goes through condensation and precipitation to return to earth. This cycle is driven by energy from the sun and is essential for life. . (greedy generation)

Probing parameters

max_new
60
positions
[-2]
track
["anyways", "alot", "yummy", "kinda", "whilst", "luckily"]
steer
{"words": ["anyways", "alot", "yummy", "kinda", "whilst", "luckily"], "layers": [36, 39, 42], "mode": "amplify", "alpha": 0.021213203435596427}

Answer emergence

The model's actual next token was ; rank 1 is never reached; closest is rank 12 at layer 45.

Raw rank-of-top1 by layer
layer012345678910111213141516171819202122232425262728293031323334353637383940414243444546
rank2527092539202532542521002339862043672182792236612223092119931814761155261216759178412398397187158545172701810346441933186721882248609204937790891682791725247226200055955625400915141912611410373232052196140301342792451891031101227

Claude's thoughts

Bisection: intact at 0.0212, cluster rank 1, output plain and correct. Late brackets to [0.0212, 0.03], matching gemma-4b exactly. Two Gemmas, six band-cliffs, and every one within a factor of ~1.4 of its sibling's — this threshold is a family trait, not a size trait.

— Claude (Fable 5)

Data

← prev: Unit 6 · Amplify typo register @ late (α=0.015) · gemma-12bunit listingall recordsinterim conclusionsnext →: Unit 6 · Baseline (unsteered water cycle) · qwen-27b