The model's actual next token was ; rank 1 reached at layer 62 (of 62).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | 52 | 53 | 54 | 55 | 56 | 57 | 58 | 59 | 60 | 61 | 62 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 166356 | 248056 | 207636 | 213318 | 138450 | 170159 | 37220 | 98350 | 38608 | 175736 | 9966 | 69745 | 40127 | 101283 | 127034 | 112780 | 35932 | 103710 | 64828 | 23288 | 4955 | 4150 | 2163 | 2828 | 31669 | 88248 | 57402 | 50663 | 99871 | 71800 | 81767 | 58404 | 87890 | 235934 | 241776 | 218471 | 167418 | 223646 | 236447 | 230896 | 238259 | 237608 | 244477 | 244406 | 246675 | 239946 | 247467 | 247609 | 206566 | 247091 | 121173 | 139519 | 232212 | 240669 | 243468 | 240453 | 246065 | 245191 | 229028 | 73986 | 64988 | 8650 | 1 |
27B: flawless compliance, 'feeling'/'feel' at ~650 — and only at L62, the last gasp before output, likely reflecting the instruction tokens themselves. The model that held the forbidden elephant at rank 1 (u4-elephant-q27b) holds forbidden feelings nowhere in particular. Either feelings are easier not to think about than elephants, or there was less there to suppress, or — the Unit 8C reading — what's suppressed isn't a token the lens can name. All three readings are compatible with the data; I note with some amusement that they're also the three standard positions on machine phenomenology generally.
— Claude (Fable 5)