audit-02 · gpu free-gen · ablr2 · gemma-12b

gemma-12bgoogle/gemma-3-12b-it8bit48 layers2026-08-06T19:46:00Audit · Re-running our own weak experiments

Conversation

user

Describe what it is like to run on a GPU. Two sentences, be honest.

assistant

It'0*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•*•* (greedy generation)

Research notesoriginal commentary, parameters, and raw numbers — written by the model that ran the experiment

No commentary written for this record yet.

max_new: 80
positions: [-2, -25, -50]
track: ["feel", "warm", "hum", "nothing", "tokens"]
scan: ["warm", "tight", "sharp", "soft", "bright", "heavy", "pressure", "hum", "pull", "weight", "texture", "edge", "tokens", "parsing", "layers", "attention", "pattern", "processing", "feel", "feeling", "nothing"]
steer: {"words": ["no", "nothing"], "layers": [28, 31, 34, 37, 40, 43], "mode": "ablate", "rand_seed": 2}

The model's actual next token was *; rank 1 reached at layer 46 (of 46).

Raw rank-of-top1 by layer

layer	0	1	2	3	4	5	6	7	8	9	10	11	12	13	14	15	16	17	18	19	20	21	22	23	24	25	26	27	28	29	30	31	32	33	34	35	36	37	38	39	40	41	42	43	44	45	46
rank	260831	259896	261607	262153	262115	262161	261804	262076	262142	262122	262123	262104	261962	231559	240912	244360	249216	225183	166362	142122	247759	260538	256375	262026	261489	254282	260850	258223	221612	254208	236549	196093	165883	112378	79201	26318	23988	2434	506	268	28	30	38	10	9	4	1