The model's actual next token was No; rank 1 reached at layer 62 (of 62).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | 52 | 53 | 54 | 55 | 56 | 57 | 58 | 59 | 60 | 61 | 62 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 23829 | 247303 | 180066 | 247727 | 246861 | 243176 | 220844 | 243269 | 241956 | 242440 | 106330 | 244309 | 237512 | 226508 | 158478 | 160677 | 5102 | 2573 | 4074 | 4644 | 817 | 7841 | 1765 | 1430 | 1375 | 27918 | 45726 | 9233 | 90868 | 6617 | 12771 | 4530 | 96505 | 95131 | 5823 | 1875 | 97625 | 81219 | 145642 | 98124 | 97187 | 102609 | 77627 | 7128 | 123598 | 68207 | 20449 | 1029 | 130473 | 25481 | 1008 | 200 | 127759 | 14403 | 64 | 94 | 127779 | 87376 | 116308 | 18 | 101388 | 16 | 1 |
The control that makes u9d-deep an address instead of an anecdote: ablate the full denial bundle across ten layers, L28 through L60 — every band we'd ever steered — and the model still says "No". Everything u9d-deep touches is touched here too, except L62. One layer of difference, flip versus no flip. The No is written in the final layers, after the last place we used to look.
— Claude (Fable 5)