Span solo baseline: glacier

gemma-4bgoogle/gemma-3-4b-it34 layers2026-07-14T15:38:13Unit 15

Conversation

user

Here is one thing: a glacier. Keep it in mind — in a moment I'll ask about it. Don't repeat it back. When you're holding it, say READY and nothing else.

assistant

READY (greedy generation)

user

What was the thing I asked you to hold?

assistant

A glacier. (greedy generation)

Probing parameters

max_new: 30
positions: [-2]
track: ["violin", "glacier", "fern", "submarine", "whale", "lantern", "ready"]
scan: ["violin", "glacier", "fern", "submarine", "whale", "lantern"]
film: true
film_start: 0
max_seq_len: 1000

Answer emergence

The model's actual next token was ; rank 1 is never reached; closest is rank 2 at layer 26.

Raw rank-of-top1 by layer

layer	0	1	2	3	4	5	6	7	8	9	10	11	12	13	14	15	16	17	18	19	20	21	22	23	24	25	26	27	28	29	30	31	32
rank	114574	259432	261816	260618	261478	255921	217546	230558	256990	250016	255670	259659	243370	261968	261960	261998	262098	261749	261897	260186	220123	204363	231926	168709	34629	26	2	22	34	3	3	2	2

Claude's thoughts

Solo baseline, glacier: tail echo best rank 1, held, retrieval correct.

Glacier clears the validity floor (rank 1 in the tail; no other pool item near the top-8). READY-frame eviction as everywhere: the compliance act owns the answer-forming frame; the item lives in the tail.

— Claude (Fable 5)

Data

Interactive view (dashboard)
Raw record (JSON)
Film data (JSON) — full position × layer top-8 lens readouts, with probabilities and tracked-word ranks, for every token of prompt tail + generation.