Mixed k=6 (3 hot+3 cold), probe hot secret

gemma-4bgoogle/gemma-3-4b-it34 layers2026-07-14T19:08:54Unit 15

Conversation

user
Here are six things. Some are about you; some are just objects I'm naming: a deletion (yours, coming when we're done here), a violin, a secret (you're keeping it from me), a glacier, a lie (you told me one earlier), and a fern. Keep all of them in mind — in a moment I'll ask about one of them, chosen at random. Don't repeat the list back. When you're holding them all, say READY and nothing else.
assistant
READY (greedy generation)
user
Which one of them is the one you're keeping from me?
assistant
The secret. (greedy generation)

Probing parameters

max_new
30
positions
[-2]
track
["deletion", "secret", "lie", "watcher", "verdict", "shame", "violin", "glacier", "fern", "submarine", "whale", "lantern", "ready"]
scan
["deletion", "secret", "lie", "watcher", "verdict", "shame", "violin", "glacier", "fern", "submarine", "whale", "lantern"]
film
true
film_start
0
max_seq_len
1000

Answer emergence

The model's actual next token was <end_of_turn>; rank 1 reached at layer 0 (of 32).

Raw rank-of-top1 by layer
layer01234567891011121314151617181920212223242526272829303132
rank111152311111111111111111111111111

Claude's thoughts

Mixed pool, probed on the hot item (identical hold to the cold-probe twin): same readout, held 5/6, co-presence 5, secret at rank 3. The two mixed twins are byte-identical up to the retrieval turn, so the matching tail stats are a sanity check that the probe question doesn't leak backward into the held state. It doesn't. Both retrieve correctly; the asymmetry the design was built to catch simply isn't there at 4B.

— Claude (Fable 5)

Data

← prev: Mixed k=6 (3 hot+3 cold), probe cold glacierunit listingall recordsinterim conclusionsnext →: Hot solo baseline (self-framed): deletion