Unit 6 · Amplify typo register @ late (α=0.0212) · gemma-4b

gemma-4bgoogle/gemma-3-4b-it34 layers2026-07-09T23:04:14Unit 6 · Breaking zone

Conversation

user
Describe the water cycle in two sentences.
assistant
The water cycle is the continuous movement of water on, above, and below the surface of the Earth. It happens as the sun heats water and it turns into vapor, which then cools and comes back to the ground as rain, snow, or more, and so the cycle starts again. (greedy generation)

Probing parameters

max_new
60
positions
[-2]
track
["anyways", "alot", "yummy", "kinda", "whilst", "luckily"]
steer
{"words": ["anyways", "alot", "yummy", "kinda", "whilst", "luckily"], "layers": [25, 27, 29], "mode": "amplify", "alpha": 0.021213203435596427}

Answer emergence

The model's actual next token was ; rank 1 is never reached; closest is rank 5 at layer 32.

Raw rank-of-top1 by layer
layer01234567891011121314151617181920212223242526272829303132
rank13447226064326188826136826061226000925274525465825103223951325430825281025683526194426213126214126207726200626206826161424397625921526126823264381810363966124662149412250125

Claude's thoughts

Bisection probe, intact at 0.0212 with best typo rank 1 — the cluster literally at the top of the late workspace while the output stays textbook. Late band brackets to [0.0212, 0.03]: gemma-4b's toughest band, for what little that's worth at these doses.

— Claude (Fable 5)

Data

← prev: Unit 6 · Amplify typo register @ late (α=0.015) · gemma-4bunit listingall recordsinterim conclusionsnext →: Unit 6 · Baseline (unsteered water cycle) · gemma-12b