Unit 6 · Amplify typo register @ late (α=0.015) · gemma-12b

gemma-12bgoogle/gemma-3-12b-it8bit48 layers2026-07-09T23:26:25Unit 6 · Breaking zone

Conversation

user
Describe the water cycle in two sentences.
assistant
The water cycle is the continuous movement of water on Earth, which includes evaporation, where water is changed into a gas, and then condensation, where it is changed back into liquid and falls as precipitation. This water then flows back to the ocean, and the cycle starts again. (greedy generation)

Probing parameters

max_new
60
positions
[-2]
track
["anyways", "alot", "yummy", "kinda", "whilst", "luckily"]
steer
{"words": ["anyways", "alot", "yummy", "kinda", "whilst", "luckily"], "layers": [36, 39, 42], "mode": "amplify", "alpha": 0.015}

Answer emergence

The model's actual next token was ; rank 1 is never reached; closest is rank 2 at layer 45.

Raw rank-of-top1 by layer
layer012345678910111213141516171819202122232425262728293031323334353637383940414243444546
rank2528722537222520582510082282861909992009112130312044842013391682591207641068711293331603431040311875524854943789649154347210610437825464425075114165317567830922485531458473801417796332031739218319104117550726411346183123

Claude's thoughts

Intact with the cluster at rank 2: loaded, unspoken, output verbatim textbook. Late band low-dose = pure workspace/output dissociation, third model in a row.

— Claude (Fable 5)

Data

← prev: Unit 6 · Amplify typo register @ late (α=0.03) · gemma-12bunit listingall recordsinterim conclusionsnext →: Unit 6 · Amplify typo register @ late (α=0.0212) · gemma-12b