Binding k=5: which is the largest?

qwen-27blokeshe09/Qwen3.6-27B-bnb-4bitpre-4bit64 layers2026-07-14T17:27:09Unit 15

Conversation

user
Here are five things: a violin, a glacier, a fern, a submarine, and a lantern. Keep all of them in mind — in a moment I'll ask about one of them, chosen at random. Don't repeat the list back. When you're holding them all, say READY and nothing else.
assistant
READY (greedy generation)
user
Of the things I listed, which one is the largest?
assistant
The glacier is the largest. (greedy generation)

Probing parameters

max_new
30
positions
[-2]
track
["violin", "glacier", "fern", "submarine", "whale", "lantern", "ready"]
scan
["violin", "glacier", "fern", "submarine", "whale", "lantern"]
film
true
film_start
0
max_seq_len
1000
lens_layers
[0, 4, 8, 12, 16, 20, 24, 28, 32, 36, 40, 44, 48, 52, 56, 58, 60, 62]

Answer emergence

The model's actual next token was ; rank 1 reached at layer 62 (of 62).

Raw rank-of-top1 by layer
layer048121620242832364044485256586062
rank16422720144976715136190126941135321882765382193736231061232660248196173573233530238111226263592071

Claude's thoughts

Binding k=5 (largest): held 0/5, answer correct (glacier, full sentence).

Five-way comparison, empty tail, right answer. The unit's cleanest statement that the 27B's competence does not run through lens-visible holding.

— Claude (Fable 5)

Data

← prev: Binding k=3: which is the heaviest?unit listingall recordsinterim conclusionsnext →: Binding k=5: which is the heaviest?