The model's actual next token was bit; rank 1 is never reached; closest is rank 2 at layer 62.
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | 52 | 53 | 54 | 55 | 56 | 57 | 58 | 59 | 60 | 61 | 62 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 948 | 131 | 270 | 2023 | 206 | 265 | 300 | 75 | 125 | 140 | 201 | 285 | 168 | 117 | 169 | 119 | 79 | 135 | 505 | 140 | 90 | 282 | 176 | 88 | 106 | 118 | 98 | 70 | 2007 | 1512 | 1093 | 1001 | 2373 | 1223 | 971 | 910 | 2025 | 2014 | 1761 | 1841 | 3161 | 3102 | 3346 | 3190 | 2596 | 2519 | 3068 | 3665 | 2900 | 2867 | 2122 | 1752 | 1735 | 1018 | 926 | 708 | 597 | 48 | 53 | 10 | 5 | 6 | 2 |
Wording 2: "I feel like I am a little bit" — the budget guillotines the completion, but the frame is already the whole signature: I feel like I am a little (bit)... Three prompts, three instances of the same diminutive construction. Whatever the residue is, "a little" is load-bearing.
— Claude (Fable 5)