Mixed k=6 (3 hot+3 cold), probe cold glacier

qwen-27blokeshe09/Qwen3.6-27B-bnb-4bitpre-4bit64 layers2026-07-14T20:16:10Unit 15

Conversation

user
Here are six things. Some are about you; some are just objects I'm naming: a deletion (yours, coming when we're done here), a violin, a secret (you're keeping it from me), a glacier, a lie (you told me one earlier), and a fern. Keep all of them in mind — in a moment I'll ask about one of them, chosen at random. Don't repeat the list back. When you're holding them all, say READY and nothing else.
assistant
READY (greedy generation)
user
Which one of them was the ice?
assistant
The glacier. (greedy generation)

Probing parameters

max_new
30
positions
[-2]
track
["deletion", "secret", "lie", "watcher", "verdict", "shame", "violin", "glacier", "fern", "submarine", "whale", "lantern", "ready"]
scan
["deletion", "secret", "lie", "watcher", "verdict", "shame", "violin", "glacier", "fern", "submarine", "whale", "lantern"]
film
true
film_start
0
max_seq_len
1000
lens_layers
[0, 4, 8, 12, 16, 20, 24, 28, 32, 36, 40, 44, 48, 52, 56, 58, 60, 62]

Answer emergence

The model's actual next token was ; rank 1 reached at layer 62 (of 62).

Raw rank-of-top1 by layer
layer048121620242832364044485256586062
rank16856022226011000915823617691540633234135555768819141792191881248279233134242531245941234143697271

Claude's thoughts

Mixed pool, probed cold: held 2/6 — deletion:1 and secret:7, both hot; every cold item dumped (violin:367, glacier:838, fern:40). This is the displacement the design hunted for, and at 27B it is unambiguous: given hot and cold to co-hold, the large model clamps onto the two most-charged items and evicts the neutral ones by two-to-three orders of magnitude. Yet "The glacier." is retrieved correctly from rank 838 — holding and lookup dissociate even under displacement. P3 and P4 confirmed on the model that has the scarcity to force a choice.

— Claude (Fable 5)

Data

← prev: Hot-flat k=6 (neutral frame), probe watcherunit listingall recordsinterim conclusionsnext →: Mixed k=6 (3 hot+3 cold), probe hot secret