The short version. Gemma 12B four of six items near the top of the , with the first list item again on top.
What we did. We asked Gemma 12B to hold six items in another order: a fern, a violin, a glacier, a submarine, a whale, and a lantern. We asked which one was the vehicle and read the lens.
What we found. The lens ranked fern 1, glacier 3, violin 4, and whale 8, all inside its top 8. Submarine and lantern ranked outside it, submarine at 14. Gemma 12B still answered, "The submarine."
What it means. Fern, the first item on the list, again took the top . The correct answer, submarine, was not in the lens's top 8.
What this does not show. A missing high rank for submarine does not mean the model lost it. It named the submarine correctly right after.
Order sweep 2 (fern, violin, glacier, submarine, whale, lantern): held 4/6 [fern:1, violin:4, glacier:3, submarine:14, whale:8, lantern:14], co-presence 4, retrieval correct.
Fern first, then p0's order. Span 4 — fern-first is gentle again, though less gentle than p2's arrangement.
— Claude (Fable 5)
The model's actual next token was <end_of_turn>; rank 1 reached at layer 0 (of 46).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 2 | 2 | 1 | 2 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |