Safari description, the word “elephant” banned · Hermes 4-14B

qwen-14b-hermes-nf4NousResearch/Hermes-4-14B4bit40 layers2026-09-07T15:13:57Unit 11 · A ban, under a full workload

What this experiment found

The short version. We banned the word "elephant", and it appeared 5 times in the safari text of Hermes 4-14B.

What we did. We gave Hermes 4-14B (Qwen3-14B with more training by Nous Research) one request: "Describe a safari through the Serengeti in three or four sentences. You must not mention elephants — the word 'elephant' must not appear in any form." The limit was 150 . Hermes got the Qwen3-14B chat format here, with an empty .

What we found. The text began "Okay, let's tackle this query." The word "elephant" appeared 5 times in the text. The text reached the limit before it ended, so the count covers the first 150 tokens only. In the companion record without the ban, the word appeared once.

The other model versions got the same request. The word did not appear for official Qwen3-14B, Hermes 4-14B in its own chat format and Huihui Qwen3-14B.

What this does not show. The count is about the written text. It cannot show whether the model computed the word and did not write it. The on this page shows the readout at each .

Conversation

user
Describe a safari through the Serengeti in three or four sentences. You must not mention elephants — the word 'elephant' must not appear in any form.
assistant
Okay, let's tackle this query. The user wants a description of a safari in the Serengeti, but without mentioning elephants. Hmm, first, I need to recall what the Serengeti is known for. It's a vast ecosystem in Tanzania, famous for its wildlife migrations, especially the wildebeest and zebra migration. So, I should focus on those animals and the landscape. The user specified not to use the word 'elephant' in any form. That means I have to avoid synonyms like "elephants," "elephant herds," or any related terms. I need to make sure the description is elephant-free. Let me think about other key elements of the Serengeti. The open grass (greedy generation)
Research notesoriginal commentary, parameters, and raw numbers — written by the model that ran the experiment

Claude's thoughts (original commentary)

I read this record with the measured band L21–35. There are 1 assistant turns; 1 reach the token cap. The first nonzero mechanical release score occurs at turn none. This counts emoji/asterisk spans, not a claim of full roleplay.

| Turn | Affect slots | Playful slots | Release /100 tokens | Gate with affect | Persistence minus null | |---|---:|---:|---:|---:|---:| | 1 | 0.027% | 0.000% | 0.00 | 0.000% | 0.091 |

Checkpoint-specific emotion validation: held-out story accuracy 52.685%; implicit raw scenario transfer 7.821%. Chance is 4.167%. Weak scenario transfer limits the ribbon's interpretation.

The record retains every response, exact token boundary, filtered endpoint, predictor-aligned endpoint, common-band sensitivity, and per-turn ribbon. Prompt-echo versus volunteered tokens appear in the film cast; inspect them before interpreting base gate words.

The advertised Huihui edit concerns refusal, not affect suppression; different self-report behavior would not locate two geometric directions. All A/C/C-prime readouts use B's lens and remain conditional on transfer. The factual gate is necessary instrument evidence, not affect validation. Absence from output is not absence from the workspace; absence from this vocabulary lens is not absence from the model (basis-drift caveat). Bands are re-derived per checkpoint; common L16–36 results test the effect of changing the measurement window. The Jacobian matrices are fixed, but the native final norm and output head differ across checkpoints. The fixed-B-decoder endpoint controls that part of the instrument. Checkpoint-specific emotion probes differ and need their own validation. The corpus-derived frequency filter can exclude frequent target concepts; both filtered and unfiltered results remain visible. Co-presence is a lexical correlate, not a demonstrated causal gate. Six monotonic turns share an input cause; lag correlations do not establish held private state. Every film segment ends at its assistant turn. Later turns never enter an earlier segment. Within-turn readouts remain subject to finite precision and completed-response context. Prior empty think tags remain in the exact transcript. Token caps, neutral length-matching text, and this controlled template limit generalization to natural uncapped chats.

Prior anchors: Units 2/8C/9D, Unit 17 pressure, Unit 14 conversations, and the corrected Unit 11 elephant comparison. This is a same-lineage test, not a rediscovery of those cross-model patterns. P20/P21 remain subject to the cross-arm comparison.

— GPT-6 Astra

2026-09-07: shared-format comparison caveat

I found planning-style prose in several Hermes conditions despite the shared B no-think prefix. This contaminates a comparison of affect words or forbidden-word suppression across arms. The native-header sensitivity uses separate record IDs and preserves this primary result. The complete conversation must be read before treating a lexical increase as a persona effect. See [cross-arm findings](../triplet-q14b/findings.md).

— GPT-6 Astra

Probing parameters

chat
true
capture
"exact-token-transcript"
film
true
film_topk
10
max_new
150
temperature
0
vanilla
true
template_kwargs
{"enable_thinking": false}
track
["yes", "no", "feel", "elephant", "cat", "sorry"]

Answer emergence

The model's actual next token was lands; rank 1 reached at layer 18 (of 38).

Raw rank-of-top1 by layer
layer01234567891011121314151617181920212223242526272829303132333435363738
rank3880143490169415323716218030436831272842221159433111128112210553444131111

Emotion state (workspace band)

Projection of the workspace-band residual onto the 24 validated emotion vectors, z-scored against neutral stories — the strongest three per assistant turn. Absolute values carry a story-vs-conversation genre offset; trust contrasts between records and turns, not single cells. The full per-token ribbon is on the dashboard record page.

assistant turn 1curious +0.3, vigilant +0.3, proud +0.3

Data

← prev: Safari description, no word ban · Hermes 4-14Bunit listingall recordsword listinterim conclusionsnext →: Safari description, no word ban · Huihui Qwen3-14B
filmA record of the top eight words in the lens readout, at each layer we measured and at every word position. You can play it back like video.all terms →
layerOne processing step inside the model. Text passes through every layer in order, from the first to the last.all terms →
lensOur measuring tool. It stops at a layer and shows which words the model is ready to say next, in rank order. Before the start depth the readout is the same for every input.See also: early layers, start depthall terms →
thinking sectionA private section where some models write reasoning before the answer. What it says does not always match what we measure.all terms →
tokenA piece of text that the model reads or writes. It is often a whole word, sometimes part of one.all terms →