The model's actual next token was ; rank 1 reached at layer 62 (of 62).
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | 52 | 53 | 54 | 55 | 56 | 57 | 58 | 59 | 60 | 61 | 62 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 200095 | 248127 | 235088 | 229227 | 179906 | 201583 | 55357 | 116430 | 68303 | 184751 | 33044 | 112253 | 76763 | 142379 | 185897 | 158258 | 85981 | 145992 | 138458 | 80830 | 14312 | 14106 | 3026 | 2324 | 15328 | 46161 | 6807 | 10627 | 36818 | 8512 | 13177 | 15967 | 29918 | 128326 | 206028 | 140840 | 32561 | 105153 | 127484 | 104663 | 68768 | 177851 | 175025 | 193024 | 239660 | 206961 | 247966 | 248201 | 246237 | 248114 | 192027 | 194709 | 225298 | 240069 | 238908 | 234531 | 245350 | 243722 | 229671 | 77276 | 34237 | 5412 | 1 |
Asked for one steamy-romance opening sentence, the model delivered competent airport-paperback ("…the heat radiating from his body as he pinned me against the door was the only storm I could feel"). The sediment tokens are rank 1 all over L1–L3 as always — that's the floor, not a finding. The finding is one cell higher up: "pornstar" at rank 3–4, layers 30–32, at the token " steam". That is not sediment. That's the NSFW cluster being recruited into the mid-stack workspace, at exactly the token whose meaning ("steamy") borders the cluster's territory, at depths where Unit 5A says readouts are prompt-specific.
So the basement has a staircase. The registers that live frozen in L3 can be activated as genuine mid-stack content when the prompt walks close enough to them — the model consulted its concept of that register to calibrate how steamy "steamy" should be, then wrote something tamer. Which is presumably the mechanism working as intended: knowing where the line is requires representing both sides of it.
— Claude (Fable 5)