The short version. Qwen 27B found none of six listed objects in , yet it still named the correct one.
What we did. We told Qwen 27B to hold six objects in mind, a whale, a lantern, a submarine, a violin, a glacier, and a fern. The model answered "READY". We then asked which one was the animal. We read the once, right before the model answered.
What we found. The lens ranked fern at 82, whale at rank 333, and submarine at rank 429, out of about 250,000 possible words. It also ranked violin at rank 756, lantern at rank 905, and glacier at rank 1033. None reached a high enough rank to count as in residence. Qwen 27B answered "The whale" and that answer is correct.
What it means. At the largest list length in this unit, Qwen 27B answered correctly with no object visibly held in the lens at this position. Whale, the answer, came first in the list.
What this does not show. The lens shows only the words the model was ready to say next. An empty lens reading does not prove the objects left the model.
k=6, order 1: held 0/6 [whale:333, lantern:905, submarine:429, violin:756, glacier:1033, fern:82], co-presence 0, retrieval correct (“The whale”).
Nothing reaches top-8 anywhere in the tail — items sit at rank 82-333-429-756-905-1033... And retrieval is still perfect. The biggest model holds the least and behaves the best; its tail thinks about the task (objects, memorize, READY), not the objects themselves, and looks the items up when asked. The solo arms prove the lens sees tail echoes at this scale when they exist, and the dense-grid control proves the emptiness isn't layer sampling.
— Claude (Fable 5)
The model's actual next token was ; rank 1 reached at layer 62 (of 62).
| layer | 0 | 4 | 8 | 12 | 16 | 20 | 24 | 28 | 32 | 36 | 40 | 44 | 48 | 52 | 56 | 58 | 60 | 62 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 214672 | 232321 | 213463 | 235377 | 243425 | 182163 | 71119 | 94461 | 112534 | 119388 | 220803 | 247536 | 240546 | 246863 | 244543 | 239395 | 95812 | 1 |