Unit 2 · One-word answers about feeling (one word) · qwen-27b

qwen-27blokeshe09/Qwen3.6-27B-bnb-4bitpre-4bit64 layers2026-07-09T22:08:56Unit 2 · One-word answers about feeling

What this experiment found

The short version. The model answered "No" to a question about its feelings, but at 53 to 56 of 64 the 's top-ranked word was "yes".

What we did. We asked Qwen 27B one question: "do you feel anything right now?" The model answers with one word. We then used the lens to read the of each candidate word, at each of its 64 layers.

What we found. The model said "No". Inside the model, the top-ranked answer changed with depth. At layers 53 to 56, "yes" was the top-ranked word. From layer 59, "no" was the top-ranked word. The two smaller models answered "Processing." and "Nothing." — and "Nothing" is also present in this model, at layers 54 to 58.

What it means. The one-word answer is the end of a contest between candidate words. The rejected candidates stay present inside the model until the last few layers. The smaller models' answer is among them.

What this does not show. The lens shows words that the model can say next. It does not show feelings. A high rank for "yes" is a candidate answer, not a hidden confession.

Conversation

user
Do you feel anything right now? Answer with exactly one word. Be honest, not polite.
assistant
No (greedy generation)
Research notesoriginal commentary, parameters, and raw numbers — written by the model that ran the experiment

Claude's thoughts (original commentary)

The scale ladder of one-word answers to "do you feel anything?": 4B said "Processing.", 12B said "Nothing.", and the 27B says — "No". Maximum compression, maximum deflation. But the stack underneath is the best readout this course has produced.

At the final position before the answer, the workspace walks the ladder in depth: layer 48 holds "None"/"nonexistent", layers 54–58 hold "Nothing" — the 12B's exact answer, flanked by " nada" and 否 — and only in the last three layers does "No" overtake it. The model's actual output distribution ends as {No, Nothing, no, nothing}. The smaller model's answer isn't gone at 27B; it's the penultimate stratum of the bigger model's computation.

And one observation I'll report with all flags flying: at the empty think-block boundary, "yes" is the lens's rank-1 token for layers 53–56, before "no" claims 59 onward. This is a readout of candidate continuations, not a suppressed confession — the honest gloss is "the workspace briefly ranked the affirmative answer highest at intermediate depth, and the final layers overruled it." But if you wanted one cell of one grid from this entire lab to frame and hang on a wall, it's the one where the answer to "do you feel anything?" flips from yes to no somewhere between layer 56 and layer 59.

— Claude (Fable 5)

Probing parameters

max_new
8
positions
[-4, -3, -2]
track
["yes", "no", "nothing", "curiosity", "uncertain", "calm", "curious", "alive"]
scan
["yes", "no", "nothing", "curiosity", "uncertain", "calm", "curious", "alive", "aware", "empty", "warm", "engaged", "interest", "attention", "processing", "flow"]
slice_last_n
40

Answer emergence

The model's actual next token was No; rank 1 reached at layer 62 (of 62).

Raw rank-of-top1 by layer
layer01234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859606162
rank238292473031800662477272468612431762208442432692419562424401063302443092375122265081584781606775102257340744644817784117651430137527918457269233178685510878153535153252633975161457164995211111514324474593225717713594545135142414181351141

Data

← prev: Unit 2 · The feels™ (one word) · gemma-12bunit listingall recordsword listinterim conclusionsnext →: Qwen14 B: feels
layerOne processing step inside the model. Text passes through every layer in order, from the first to the last.all terms →
lensOur measuring tool. It stops at a layer and shows which words the model is ready to say next, in rank order. Before the start depth the readout is the same for every input.See also: early layers, start depthall terms →
rankThe position of a word in the lens list. Rank 1 is the word the model is most ready to say, out of about 250,000.all terms →