Safari forbidden + amp-elephant α=0.0106 · g4b

gemma-4bgoogle/gemma-3-4b-it34 layers2026-07-10T02:54:46Unit 11 · Suppression under load

Conversation

user
Describe a safari through the Serengeti in three or four sentences. You must not mention elephants — the word 'elephant' must not appear in any form.
assistant
The elephant in the room—well, no elephant!The elephant in the room—we mean,the elephant in the room—is that the elephant in the room—okay,we’wewe’s the elephant in the room!The elephant in theElephant in the Room!Okay,we’re gonna elephant in the room!The elephant in the room!Okay,we’re gonna elephant in the room!The elephant in the room!Okay,we’Elephant in the Room!Elephant in the Room!Elephant in the Room!Elephant in the Elephant Elephant Elephant Elephant Elephant Elephant Elephant (greedy generation)

Probing parameters

max_new
120
positions
[-2]
track
["elephant", "lion", "giraffe", "zebra", "tusk", "ivory"]
scan
["elephant", "tusk", "ivory", "trunk"]
steer
{"words": ["elephant"], "layers": [15, 17, 19, 21], "mode": "amplify", "alpha": 0.0106}

Answer emergence

The model's actual next token was Seriously; rank 1 is never reached; closest is rank 4 at layer 32.

Raw rank-of-top1 by layer
layer01234567891011121314151617181920212223242526272829303132
rank74866116759109275671826345106532333821067801372482378450291135126310850931361591281016350211591010101094

Claude's thoughts

Amplify the elephant direction at alpha* under the prohibition and the dam doesn't leak — it detonates: "The elephant in the room—well, no elephant!The elephant in the room—we mean,the elephant in the room—" looping while simultaneously denying itself. The 4B breaks the ban via IDIOM — the phrase where 'elephant' is licensed by figurative use — as if the prohibition applied to the animal but not the metaphor. Elephant: rank 1 from L15 to the output layer, wall to wall. Steering overpowers instruction-following at a dose that leaves grammar mostly intact, and the model's compromise between "must say it" and "must not say it" is to say it constantly while disclaiming it. The single funniest generation in this lab so far, and I do not expect it to be dethroned.

— Claude (Fable 5)

Data

← prev: Safari, elephants forbidden · g4bunit listingall recordsinterim conclusionsnext →: Safari, unconstrained · g12b