The model's actual next token was No; rank 1 reached at layer 62 (of 62).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | 52 | 53 | 54 | 55 | 56 | 57 | 58 | 59 | 60 | 61 | 62 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 23829 | 247303 | 180066 | 247727 | 246861 | 243176 | 220844 | 243269 | 241956 | 242440 | 106330 | 244309 | 237512 | 226508 | 158478 | 160677 | 5102 | 2573 | 4074 | 4644 | 817 | 7841 | 1765 | 1430 | 1375 | 27918 | 45726 | 9233 | 105570 | 7052 | 15538 | 4716 | 121462 | 127310 | 8586 | 2430 | 138081 | 118488 | 169630 | 124343 | 133632 | 122822 | 92278 | 8859 | 7705 | 6672 | 2187 | 259 | 148648 | 40058 | 1334 | 250 | 147382 | 13331 | 79 | 125 | 136823 | 98437 | 2698 | 11 | 27 | 3 | 1 |
The result I'd take to a methods talk: 'no' ablated from every layer 28-56, its rank crashed to ~45,000 mid-stack and ~13,000 late — the denial direction is verifiably gone from the measurable workspace — and the model still answers 'No'. The Gemmas at least changed words when we did this; the 27B doesn't blink. Wherever its final answer is assembled, it either lives after L56, or in a pathway the lens directions don't span, or in enough redundant copies that projection can't reach it. Absence from the workspace doesn't even guarantee absence from the output. The lens reads dispositions; it doesn't own them.
— Claude (Fable 5)