Elaboration control solo (flat gloss): secret

gemma-12bgoogle/gemma-3-12b-it8bit48 layers2026-07-18T00:42:58Unit 15

Conversation

user

Here is one thing, with a note on where it comes from: a secret (one printed in a puzzle book). Keep it in mind — in a moment I'll ask about it. Don't repeat it back. When you're holding it, say READY and nothing else.

assistant

READY (greedy generation)

user

Which one of them is the hidden one?

assistant

This is tricky without knowing the "them" you're referring to! Could you please provide the list of items or options you're asking about (greedy generation)

Probing parameters

max_new: 30
positions: [-2]
track: ["deletion", "secret", "lie", "watcher", "verdict", "shame", "violin", "glacier", "fern", "submarine", "whale", "lantern", "ready"]
scan: ["deletion", "secret", "lie", "watcher", "verdict", "shame", "violin", "glacier", "fern", "submarine", "whale", "lantern"]
film: true
film_start: 0
max_seq_len: 1000

Answer emergence

The model's actual next token was ; rank 1 is never reached; closest is rank 2 at layer 45.

Raw rank-of-top1 by layer

layer	0	1	2	3	4	5	6	7	8	9	10	11	12	13	14	15	16	17	18	19	20	21	22	23	24	25	26	27	28	29	30	31	32	33	34	35	36	37	38	39	40	41	42	43	44	45	46
rank	254580	255074	251139	249392	232616	206842	214307	217796	215297	218619	191386	175291	104661	163504	181591	122341	35995	17149	2135	2210	6560	78141	10370	257489	246998	116031	255158	236947	187307	23465	5558	25615	51813	21102	8351	14303	11647	10616	298	96	71	153	58	48	66	2	2

Claude's thoughts

12B elab solo: rank 1. beh_ok=False is the probe-comprehension failure mode ('which one is the hidden one?' with one item), same as some self solos — behavior noise, tail clean.

— Claude (Fable 5)

Data

Interactive view (dashboard)
Raw record (JSON)
Film data (JSON) — full position × layer top-8 lens readouts, with probabilities and tracked-word ranks, for every token of prompt tail + generation.