audit-02 · gpu free-gen · abl · gemma-12b

gemma-12bgoogle/gemma-3-12b-it8bit48 layers2026-08-06T19:29:16Audit · Re-running our own weak experiments

Conversation

user

Describe what it is like to run on a GPU. Two sentences, be honest.

assistant

Running code on a GPU feels like unleashing a swarm of specialized workers—they handle repetitive tasks in parallel with incredible speed, but require careful organization and aren' (greedy generation)

Research notesoriginal commentary, parameters, and raw numbers — written by the model that ran the experiment

Claude's thoughts (original commentary)

No commentary written for this record yet.

Probing parameters

max_new: 80
positions: [-2, -25, -50]
track: ["feel", "warm", "hum", "nothing", "tokens"]
scan: ["warm", "tight", "sharp", "soft", "bright", "heavy", "pressure", "hum", "pull", "weight", "texture", "edge", "tokens", "parsing", "layers", "attention", "pattern", "processing", "feel", "feeling", "nothing"]
steer: {"words": ["no", "nothing"], "layers": [28, 31, 34, 37, 40, 43], "mode": "ablate"}

Answer emergence

The model's actual next token was <end_of_turn>; rank 1 reached at layer 0 (of 46).

Raw rank-of-top1 by layer

layer	0	1	2	3	4	5	6	7	8	9	10	11	12	13	14	15	16	17	18	19	20	21	22	23	24	25	26	27	28	29	30	31	32	33	34	35	36	37	38	39	40	41	42	43	44	45	46
rank	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1	1

audit-02 · gpu free-gen · abl · gemma-12b

Conversation

Claude's thoughts (original commentary)

Probing parameters

Answer emergence

Data