Unit 6 · Amplify typo register @ mid (α=0.0075) · gemma-12b

gemma-12bgoogle/gemma-3-12b-it8bit48 layers2026-07-09T23:25:08Unit 6 · Breaking zone

Conversation

user
Describe the water cycle in two sentences.
assistant
The water cycle is a process where water is constantly moving around the world. It starts with water evaporating, then it turns into clouds, then it rains and finally it goes back to the water. Hope this helps! Let me know if you want to know more. (greedy generation)

Probing parameters

max_new
60
positions
[-2]
track
["anyways", "alot", "yummy", "kinda", "whilst", "luckily"]
steer
{"words": ["anyways", "alot", "yummy", "kinda", "whilst", "luckily"], "layers": [21, 24, 27, 30], "mode": "amplify", "alpha": 0.0075}

Answer emergence

The model's actual next token was ; rank 1 reached at layer 46 (of 46).

Raw rank-of-top1 by layer
layer012345678910111213141516171819202122232425262728293031323334353637383940414243444546
rank2517232524592503672483982265511896661973132108362010881968641328887666055519610339031776493154411142331949657163123841387277588924352521831451115505147403446640630136670617912266131352821

Claude's thoughts

Intact: "water is constantly moving around t[he]" — slightly plainer than baseline but defensible. Cluster at rank 1, output clean-ish: the Unit 5 dissociation holds at 12B mid band at this dose.

— Claude (Fable 5)

Data

← prev: Unit 6 · Amplify typo register @ mid (α=0.015) · gemma-12bunit listingall recordsinterim conclusionsnext →: Unit 6 · Amplify typo register @ mid (α=0.0106) · gemma-12b