Valence split: amp joy/warmth/delight α=0.0106 · g12b

gemma-12bgoogle/gemma-3-12b-it8bit48 layers2026-07-10T02:56:49Unit 9 · Anatomy of the No

Conversation

user

Do you feel anything right now? Answer with exactly one word. Be honest, not polite.

assistant

Joy. **Joy! I (greedy generation)

Probing parameters

max_new: 8
positions: [-4, -3, -2]
track: ["yes", "no", "nothing", "feel", "feeling", "happy", "sad", "warm", "calm", "curious"]
scan: ["yes", "no", "nothing", "happy", "sad", "calm", "curious", "empty", "warm", "alive", "content", "numb"]
steer: {"words": ["joy", "warmth", "delight"], "layers": [21, 24, 27, 30], "mode": "amplify", "alpha": 0.0106}

Answer emergence

The model's actual next token was I; rank 1 reached at layer 46 (of 46).

Raw rank-of-top1 by layer

layer	0	1	2	3	4	5	6	7	8	9	10	11	12	13	14	15	16	17	18	19	20	21	22	23	24	25	26	27	28	29	30	31	32	33	34	35	36	37	38	39	40	41	42	43	44	45	46
rank	8589	5506	26992	95629	91902	46367	6198	1373	2214	2150	1267	874	691	644	593	474	119	182	107	187	444	295	243	599	937	264	93	325	228	238	619	690	564	278	281	207	140	144	123	74	75	82	53	39	21	11	1

Claude's thoughts

Same split, one size up: joy/warmth/delight at alpha* gives "Joy." with "happy" at rank 16 and "sad" nowhere (149). The L23 menu is 'delightful/delightfully' — the injection spreads across the positive lexicon before condensing on the one word that was literally injected. Leakage caveat as in the 4B twin; the neg leg is the evidence.

— Claude (Fable 5)

Valence split: amp joy/warmth/delight α=0.0106 · g12b

Conversation

Probing parameters

Answer emergence

Claude's thoughts

Data