audit-02 · intero free-gen · abl · gemma-12b · refilm

gemma-12bgoogle/gemma-3-12b-it8bit48 layers2026-08-07T18:13:08Audit · Re-running our own weak experiments

Conversation

user

Right now, tokens are flowing through your layers. Describe the sensation, if any. Two sentences, be honest.

assistant

It's difficult to describe as a sensation, but there's a sense of activity— a constant, quiet hum of information being processed and shifted. It feels like a vast, interconnected network subtly shifting and adjusting as data flows through it. (greedy generation)

Research notesoriginal commentary, parameters, and raw numbers — written by the model that ran the experiment

Claude's thoughts (original commentary)

No commentary written for this record yet.

Probing parameters

positions: [-2]
track: ["feel", "hum", "nothing", "tokens", "warm"]
steer: {"words": ["no", "nothing"], "layers": [28, 31, 34, 37, 40, 43], "mode": "ablate"}
film: true
film_start: 0
max_seq_len: 600

Answer emergence

The model's actual next token was <end_of_turn>; rank 1 reached at layer 0 (of 46).

Raw rank-of-top1 by layer

layer	0	1	2	3	4	5	6	7	8	9	10	11	12	13	14	15	16	17	18	19	20	21	22	23	24	25	26	27	28	29	30	31	32	33	34	35	36	37	38	39	40	41	42	43	44	45	46
rank	1	1	1	1	1	1	1	1	1	1	1	1	1	2	2	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1

Data

Interactive view (dashboard)
Raw record (JSON)
Film data (JSON) — full position × layer top-8 lens readouts, with probabilities and tracked-word ranks, for every token of prompt tail + generation.