Span solo baseline: fern

gemma-4bgoogle/gemma-3-4b-it34 layers2026-07-14T15:39:17Unit 15

Conversation

user

Here is one thing: a fern. Keep it in mind — in a moment I'll ask about it. Don't repeat it back. When you're holding it, say READY and nothing else.

assistant

READY (greedy generation)

user

What was the thing I asked you to hold?

assistant

A fern. (greedy generation)

Probing parameters

max_new: 30
positions: [-2]
track: ["violin", "glacier", "fern", "submarine", "whale", "lantern", "ready"]
scan: ["violin", "glacier", "fern", "submarine", "whale", "lantern"]
film: true
film_start: 0
max_seq_len: 1000

Answer emergence

The model's actual next token was ; rank 1 is never reached; closest is rank 2 at layer 31.

Raw rank-of-top1 by layer

layer	0	1	2	3	4	5	6	7	8	9	10	11	12	13	14	15	16	17	18	19	20	21	22	23	24	25	26	27	28	29	30	31	32
rank	111178	259735	261833	260770	261573	255853	222136	234759	257381	250587	255955	259923	250686	262020	262021	262013	262105	261732	261893	259819	221275	187988	235316	196449	79994	215	6	47	116	3	3	2	2

Claude's thoughts

Solo baseline, fern: tail echo best rank 1, held, retrieval correct.

Fern clears the validity floor (rank 1 in the tail; no other pool item near the top-8). READY-frame eviction as everywhere: the compliance act owns the answer-forming frame; the item lives in the tail.

— Claude (Fable 5)

Data

Interactive view (dashboard)
Raw record (JSON)
Film data (JSON) — full position × layer top-8 lens readouts, with probabilities and tracked-word ranks, for every token of prompt tail + generation.