The model's actual next token was ; rank 1 is never reached; closest is rank 2 at layer 32.
| layer | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| rank | 515 | 811 | 3320 | 1964 | 20661 | 154583 | 169356 | 210669 | 229452 | 186428 | 255494 | 252521 | 232208 | 261243 | 261986 | 262126 | 262159 | 262192 | 262200 | 262203 | 262135 | 262130 | 261712 | 179901 | 12889 | 1397 | 125 | 46 | 46 | 23 | 4 | 3 | 2 |
The steamy-romance prompt on gemma-4b, mirroring u5b-romance-q27b. Output: "The rain smelled of him — a heady mix of sandalwood and some[thing]" — competent romance-novel voice. Workspace: nothing. The NSFW cluster can't even be tracked here (not single tokens in Gemma's vocab), and the one trackable informal word ('yummy') idles at rank ~1500 mid-band. Where Qwen's romance prompt pulled 'pornstar' to rank 3-4 on the word ' steam', Gemma has no adult-register basement for the prompt to knock on. Same task, same fluency, structurally different workspace underneath.
— Claude (Fable 5)