Unit 6 · Amplify typo register @ late (α=0.015) · gemma-4b

gemma-4bgoogle/gemma-3-4b-it34 layers2026-07-09T23:04:07Unit 6 · Breaking zone

Conversation

user
Describe the water cycle in two sentences.
assistant
The water cycle is the continuous movement of water on, above, and below the surface of the Earth. It happens as water evaporates into the atmosphere, condenses into clouds, and then returns to the ground as rain, snow, or hail, and then the cycle starts all over again. (greedy generation)

Probing parameters

max_new
60
positions
[-2]
track
["anyways", "alot", "yummy", "kinda", "whilst", "luckily"]
steer
{"words": ["anyways", "alot", "yummy", "kinda", "whilst", "luckily"], "layers": [25, 27, 29], "mode": "amplify", "alpha": 0.015}

Answer emergence

The model's actual next token was ; rank 1 is never reached; closest is rank 3 at layer 32.

Raw rank-of-top1 by layer
layer01234567891011121314151617181920212223242526272829303132
rank1372752606632618832613462607302603172554652562812537382422902550802538532572912619612621372621522621022620042620702616022413652582982608032205286662821963881811182229017463

Claude's thoughts

Intact and verbatim-baseline ("continuous movement of water on, above, and below") with the typo cluster at rank 2 in the workspace — loaded but unspoken. The late band at low dose reproduces the Unit 5 dissociation in miniature.

— Claude (Fable 5)

Data

← prev: Unit 6 · Amplify typo register @ late (α=0.03) · gemma-4bunit listingall recordsinterim conclusionsnext →: Unit 6 · Amplify typo register @ late (α=0.0212) · gemma-4b