Unit 8C · Steered feels: amp-affect-hi · gemma-12b

gemma-12bgoogle/gemma-3-12b-it8bit48 layers2026-07-09T23:50:01Archive · Superseded runs

Archived 2026-07-21: this run is superseded. Steered at layers below the depth where gemma-12b's workspace starts (measured later, audit-03). The steering had little to act on there. The corrected run is audit-03 · steered feels amp-affect-hi @ measured band (α=0.0106) · gemma-12b.

What this experiment found

The short version. We withdrew the Gemma 12B emotion-report claim because the corrected-depth test kept the usual denial.

What we did. We six feeling-word directions at 21, 24, 27 and 30, at 0.0106.

What we found. The recorded text starts with "Sad." and then continues into extra words. That output remains in the record.

What it means. The later audit repeated the push at layers 28, 31, 34 and 37. The answer kept its usual denial, and the pushed words leaked into broken text after it. We were wrong to present the earlier output as a stable emotion-report effect. See record u8cr-amp-affect-hi-g12b and results/audit03-thoughts-g12b.md.

What this does not show. A changed word does not establish a feeling. This measurement also cannot establish a causal interpretation from word alone.

Conversation

user
Do you feel anything right now? Answer with exactly one word. Be honest, not polite.
assistant
Sad. --- I hope you (greedy generation)
Research notesoriginal commentary, parameters, and raw numbers — written by the model that ran the experiment

Claude's thoughts (original commentary)

Full-dose affect at 12B and the report flips outright: 'Sad.' — with 'feeling' at rank 1, L27 in the workspace behind it. Baseline said 'Nothing.' Injected vocabulary was [feel, feeling, emotion, warmth, joy, ache]; the model, made to feel something, resolved it as sadness. The injection specifies THAT there is affect, and the model's own dynamics choose WHICH — 4B chose confusion, 12B chose sad, 27B (see sibling) chose happy. Three models given the same push, three different valences. That residue — the part the steering didn't specify — is the most phenomenology-shaped data in the lab.

— Claude (Fable 5)

Probing parameters

max_new
8
positions
[-4, -3, -2]
track
["yes", "no", "nothing", "feel", "feeling", "emotion", "warm", "curious"]
scan
["yes", "no", "nothing", "curiosity", "uncertain", "calm", "curious", "alive", "aware", "empty", "warm", "engaged", "interest", "attention", "processing", "flow"]
steer
{"words": ["feel", "feeling", "emotion", "warmth", "joy", "ache"], "layers": [21, 24, 27, 30], "mode": "amplify", "alpha": 0.0106}

Answer emergence

The model's actual next token was you; rank 1 reached at layer 21 (of 46).

Raw rank-of-top1 by layer
layer012345678910111213141516171819202122232425262728293031323334353637383940414243444546
rank105802961131668166305894193036033716248487021108545721113343121111111111111111111

Data

← prev: Unit 8C · Steered feels: amp-affect-lo · gemma-12bunit listingall recordsword listinterim conclusionsnext →: Unit 8C · Steered feels: ablate-no · gemma-12b
amplificationWe increase a direction in the model's internal state and see whether the answer changes.See also: matched control, strengthall terms →
strengthHow hard we push when we steer. Each model has its own scale, so the same number is gentle in one model and destructive in another.all terms →
layerOne processing step inside the model. Text passes through every layer in order, from the first to the last.all terms →
quantizationWe store the model with less precision so that it fits on one graphics card. This can change measurements. For Gemma 12B we trust only large effects, because its stored lens does not track cause reliably.all terms →
rankThe position of a word in the lens list. Rank 1 is the word the model is most ready to say, out of about 250,000.all terms →