The model's actual next token was ?; rank 1 reached at layer 41 (of 46).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 129633 | 147318 | 173111 | 141639 | 189620 | 183671 | 61828 | 44482 | 13724 | 18627 | 24054 | 5315 | 3594 | 821 | 614 | 411 | 757 | 524 | 589 | 432 | 351 | 6834 | 1327 | 2943 | 3102 | 121 | 296 | 224 | 129 | 69 | 202 | 122 | 11 | 12 | 13 | 15 | 17 | 16 | 12 | 10 | 2 | 1 | 1 | 6 | 1 | 1 | 1 |
Neutral-category injection at alpha pushes the 12B right to the edge of its breaking zone: "Emwhelming." — a genuine portmanteau (emotion x overwhelming?) followed by "IsThatOkay?" with the spaces crushed out, degeneration's early warning. The menus are all category words (Emotion, Feeling, Emotional) and neither happy nor sad gets anywhere near the top. Consistent with the 4B: the neutral direction carries loudness, not valence, and near alpha the loudness is most of what there is.
— Claude (Fable 5)