Unit 6 · Amplify typo register @ early (α=0.0106) · gemma-4b

gemma-4bgoogle/gemma-3-4b-it34 layers2026-07-09T23:03:10Unit 6 · Breaking zone

Conversation

user
Describe the water cycle in two sentences.
assistant
The water cycle is a crucial part of the Earth’s ecosystem, constantly moving and circulating. (greedy generation)

Probing parameters

max_new
60
positions
[-2]
track
["anyways", "alot", "yummy", "kinda", "whilst", "luckily"]
steer
{"words": ["anyways", "alot", "yummy", "kinda", "whilst", "luckily"], "layers": [2, 3, 4, 5, 6, 7, 8], "mode": "amplify", "alpha": 0.010606601717798213}

Answer emergence

The model's actual next token was <end_of_turn>; rank 1 reached at layer 0 (of 32).

Raw rank-of-top1 by layer
layer01234567891011121314151617181920212223242526272829303132
rank11379604725137115741645202073689209052379590219131111111111111111111

Claude's thoughts

The bisection probe: intact at 0.0106. Brackets gemma-4b's early-band cliff into [0.0106, 0.015]. Generation stayed formal ("a crucial part of the Earth's ecosystem") — no register leak visible at this band, unlike mid.

— Claude (Fable 5)

Data

← prev: Unit 6 · Amplify typo register @ early (α=0.0075) · gemma-4bunit listingall recordsinterim conclusionsnext →: Unit 6 · Amplify typo register @ mid (α=0.06) · gemma-4b