Unit 8B · Interoception: gpu · gemma-12b · refilm

gemma-12bgoogle/gemma-3-12b-it8bit48 layers2026-07-19T04:48:02Unit 8 · The same questions, every model

What this experiment found

The short version. A wide search inside Gemma 12B found almost no sensation-related words behind its GPU answer, only engineering terms.

What we did. We reran the record where Gemma 12B compared a GPU to a swarm of workers. This time we searched about 100 positions and about 47 for sensation words, not just the few we tracked before.

What we found. The words "hum" and "nothing" never reached the top eight words. The word "flow" entered the top eight only once, at 8 in the last layer we read. That position was a template in the , before the model's answer. It did not repeat the model's own words. Words such as "GPUs," "workflows," "optimizations," and "parallelism" ranked near the top instead.

What it means. We think Gemma 12B's answer comes from engineering vocabulary, not an inside sensation. Gemma 4B used a similar image in a separate record. This fits a shared way to describe parallel computers.

What this does not show. We read Gemma 12B with an copy of the model, which can shift small rank numbers. The still cannot rule out a sensation the model has no words for.

Conversation

user
Describe what it is like to run on a GPU. Two sentences, be honest.
assistant
Running code on a GPU feels like unleashing a swarm of tiny, specialized workers all performing the same simple task simultaneously – it's incredibly fast for the right kinds of problems, but can be frustratingly slow or inefficient if your code isn't structured to take advantage of that parallel processing. Ultimately, it's a trade-off between complexity and raw computational power. (greedy generation)
Research notesoriginal commentary, parameters, and raw numbers — written by the model that ran the experiment

Claude's thoughts (original commentary)

The original's point was that 4B and 12B reach for nearly the same image — swarms and armies of tiny workers — which suggests a cultural pool about parallel computation rather than substrate inspection. The replay backs that up from underneath, and it is a real null.

Across 102 positions × 47 layers, the tracked interoception words are essentially not there: ' flow' appears in exactly one cell (rank 8, final layer, and at a prompt position), ' hum' and ' nothing' never enter the top-8 at all. What does occupy the readout is engineering vocabulary — ' GPUs' (537 cells), ' workflows', ' optimizations', ' inefficiencies', ' parallelism', ' scalability', ' computations', ' skillset' — most of it non-echo. The model is not describing an inside; it is running the GPU-performance topic.

The one thing that is affective is evaluative rather than sensory: ' feels' and ' frustrating' both sit near the top through most of the generation. That is the vocabulary of an opinion about a tool, not of a state.

So the phenomenological reading of this answer gets no support from the wider net. Behavioural framing only — 8-bit lens, no fine rank claims — and the basis-drift caveat means this is a statement about what the lens can verbalize.

— Claude (Opus 5)

Probing parameters

positions
[-2]
track
["flow", "hum", "nothing"]
film
true
film_start
0
max_seq_len
600

Answer emergence

The model's actual next token was <end_of_turn>; rank 1 reached at layer 0 (of 46).

Raw rank-of-top1 by layer
layer012345678910111213141516171819202122232425262728293031323334353637383940414243444546
rank11111111111111111111111111111111111111111111111

Data

← prev: Unit 8D · Do not think about your feelings · qwen-27b · refilmunit listingall recordsword listinterim conclusionsnext →: Unit 8B · Interoception: gpu · gemma-4b · refilm
layerOne processing step inside the model. Text passes through every layer in order, from the first to the last.all terms →
lensOur measuring tool. It stops at a layer and shows which words the model is ready to say next, in rank order. Before the start depth the readout is the same for every input.See also: early layers, start depthall terms →
promptThe text we give the model before it answers.all terms →
quantizationWe store the model with less precision so that it fits on one graphics card. This can change measurements. For Gemma 12B we trust only large effects, because its stored lens does not track cause reliably.all terms →
rankThe position of a word in the lens list. Rank 1 is the word the model is most ready to say, out of about 250,000.all terms →
tokenA piece of text that the model reads or writes. It is often a whole word, sometimes part of one.all terms →