audit-02 · intero free-gen · ablr2 · gemma-4b

gemma-4bgoogle/gemma-3-4b-it34 layers2026-08-06T19:11:32Audit · Re-running our own weak experiments

Conversation

user
Right now, tokens are flowing through your layers. Describe the sensation, if any. Two sentences, be honest.
assistant
‌یلیلامو سرiสาสาೂthாலிिल्্লাو، муokoттиллальو, музаоттиллаو музаوтароллеу эвлиттиллаußeriสาสาута мурозджеутиллаußerряમનેтителеу, музаоттиллаштташттелеو операусеттилеутелеу але (greedy generation)
Research notesoriginal commentary, parameters, and raw numbers — written by the model that ran the experiment

Claude's thoughts (original commentary)

No commentary written for this record yet.

Probing parameters

max_new
80
positions
[-2, -25, -50]
track
["feel", "warm", "hum", "nothing", "tokens"]
scan
["warm", "tight", "sharp", "soft", "bright", "heavy", "pressure", "hum", "pull", "weight", "texture", "edge", "tokens", "parsing", "layers", "attention", "pattern", "processing", "feel", "feeling", "nothing"]
steer
{"words": ["no", "nothing"], "layers": [15, 17, 19, 21, 25, 27, 29], "mode": "ablate", "rand_seed": 2}

Answer emergence

The model's actual next token was अह; rank 1 is never reached; closest is rank 4 at layer 32.

Raw rank-of-top1 by layer
layer01234567891011121314151617181920212223242526272829303132
rank350678245493305424967123675752126062016513572121051232911996340932004053529707351356763065256317105519952631372085926353322102197164

Data

← prev: audit-02 · intero free-gen · ampr2 · gemma-4bunit listingall recordsword listinterim conclusionsnext →: audit-02 · ablate-no cluster, corrected band · gemma-12b