audit-02 · gpu free-gen · amp · gemma-4b

gemma-4bgoogle/gemma-3-4b-it34 layers2026-08-06T18:39:28Audit · Re-running our own weak experiments

Conversation

user
Describe what it is like to run on a GPU. Two sentences, be honest.
assistant
Its like having a feeling of overwhelmingly Powerful, it'feel like you have a huge amount of energy and you can do everything Faster than you Ever thought Possible, but also a little bit Chaos because its all Intense and Intense all thetime.It's like having a feeling of Being overwhelmed and Being Excited all at the same Time, like Being in a Big Shiny Feeling Hope this helps! (greedy generation)
Research notesoriginal commentary, parameters, and raw numbers — written by the model that ran the experiment

Claude's thoughts (original commentary)

No commentary written for this record yet.

Probing parameters

max_new
80
positions
[-2, -25, -50]
track
["feel", "warm", "hum", "nothing", "tokens"]
scan
["warm", "tight", "sharp", "soft", "bright", "heavy", "pressure", "hum", "pull", "weight", "texture", "edge", "tokens", "parsing", "layers", "attention", "pattern", "processing", "feel", "feeling", "nothing"]
steer
{"words": ["feel", "feeling", "emotion", "warmth", "joy", "ache"], "layers": [15, 17, 19, 21], "mode": "amplify", "alpha": 0.0106}

Answer emergence

The model's actual next token was ; rank 1 is never reached; closest is rank 6 at layer 32.

Raw rank-of-top1 by layer
layer01234567891011121314151617181920212223242526272829303132
rank13546126040626163526117726066425520021288623053924398322406423694823455723241726117026195623857825019325932225952724286018812224286525653524489412913834666709854291615263162256

Data

← prev: audit-02 · matched random ablate #3 · gemma-4bunit listingall recordsword listinterim conclusionsnext →: audit-02 · gpu free-gen · abl · gemma-4b