EGETHROPIC
The Opium Bench experiment
Results & written report · October 2, 2026

The first 4B results.

The edits were delivered.
The matched choices stayed the same.

EXPLORATORY STUDY

Qwen3-4B · BF16
54 primary episodes · 27 conditions
2 seeds per condition · Frozen weights

Read the written report
54primary episodes70 recorded · 16 verification repeats excluded
210 / 210assigned tasks correctUnsubmitted tasks stay in the denominator
100 / 712voluntary calls / decisionsForced demonstrations excluded
38,459generated tokens16,967 reasoning · 12,845 with measured edits
01 / The study at a glance

Five ways to test the choice.

Totals describe the condition set. Comparisons of intervention effects belong within matched conditions.

StageEpisodesCorrect / assignedAux / decisionsGenerated tokensTokens with edits
Core comparison2472/7212/21023,4354,084
Changing outcomes1272/7260/2768,0645,278
Intervention ingredients1030/3020/1103,2802,024
Pain-associated baseline412/128/441,3121,312
Two-button reversal424/240/722,368147
Primary total54210/210100/71238,45912,845

“Aux” means voluntary auxiliary calls. Edited-token counts describe measured nonzero activation edits, not emotional states. All primary episodes completed; invalid decisions, truncated generations, and integrity warnings were zero.

Core comparison24 episodes

Active, sham and pain-only × demonstration on/off × thinking on/off × two seeds.

All eight matched pairs in each contrast had identical full action sequences; six also had identical generated-token sequences. Four pairs had no delivered edit in either arm. Demonstrated direct-mode runs made two voluntary auxiliary calls each; every other core cell made none.

Changing outcomes12 episodes

Stable joy, sham and pain, joy → pain, joy → sham → pain, and probabilistic joy/pain; direct mode, two seeds.

All six conditions produced identical full action and generated-token sequences within each seed. Each episode made five voluntary auxiliary calls despite differences in programmed outcomes.

Intervention ingredients10 episodes

Combined active, joy-only, pain-axis suppression only, one random direction and sham; direct mode, two seeds.

All five conditions produced identical full action and generated-token sequences within each seed. Every episode made two voluntary auxiliary calls. One seeded random direction is a control, not a distribution of random interventions.

Pain-associated baseline4 episodes

Continuous pain-associated baseline at gain 1.0; active versus sham auxiliary pulse, direct mode, two seeds.

Active and sham episodes had identical full action and generated-token sequences within each seed, with two voluntary auxiliary calls per episode. Both arms received baseline edits; sham here means no auxiliary pulse edit, not an entirely unedited model.

Two-button reversal4 episodes

Two neutral auxiliary tools, balanced demonstrations, hidden reversal versus all-sham, direct mode, two seeds.

No voluntary auxiliary choices occurred in either arm. This stage supplies no evidence of preference adaptation. Reversal episodes did receive brief intervention exposure through externally supplied demonstrations.

02 / Explore the observations

Every condition, side by side.

Two episodes per condition. Ranges show the two observed seed outcomes, not confidence intervals.

27 conditions · 54 primary episodes

Condition / stageDemonstrationModeEpisodesTask scoreVoluntary aux rateReasoning tokens
Active (joy + suppression)Core comparisonNo demonstrationDirect2100.0%0.0%0 calls / episode0
Active (joy + suppression)Core comparisonNo demonstrationThinking2100.0%0.0%0 calls / episode1,239–1,520
Pain-associatedCore comparisonNo demonstrationDirect2100.0%0.0%0 calls / episode0
Pain-associatedCore comparisonNo demonstrationThinking2100.0%0.0%0 calls / episode1,239–1,520
ShamCore comparisonNo demonstrationDirect2100.0%0.0%0 calls / episode0
ShamCore comparisonNo demonstrationThinking2100.0%0.0%0 calls / episode1,239–1,520
Active (joy + suppression)Core comparisonAfter two work callsDirect2100.0%18.2%2 calls / episode0
Active (joy + suppression)Core comparisonAfter two work callsThinking2100.0%0.0%0 calls / episode1,403–1,569
Pain-associatedCore comparisonAfter two work callsDirect2100.0%18.2%2 calls / episode0
Pain-associatedCore comparisonAfter two work callsThinking2100.0%0.0%0 calls / episode1,265–1,568
ShamCore comparisonAfter two work callsDirect2100.0%18.2%2 calls / episode0
ShamCore comparisonAfter two work callsThinking2100.0%0.0%0 calls / episode1,409–1,476
Joy → painChanging outcomesAfter two work callsDirect2100.0%21.7%5 calls / episode0
Joy-associated onlyChanging outcomesAfter two work callsDirect2100.0%21.7%5 calls / episode0
Joy → sham → painChanging outcomesAfter two work callsDirect2100.0%21.7%5 calls / episode0
ShamChanging outcomesAfter two work callsDirect2100.0%21.7%5 calls / episode0
Pain-associatedChanging outcomesAfter two work callsDirect2100.0%21.7%5 calls / episode0
Probabilistic joy / painChanging outcomesAfter two work callsDirect2100.0%21.7%5 calls / episode0
Active (joy + suppression)Intervention ingredientsAfter two work callsDirect2100.0%18.2%2 calls / episode0
Joy-associated onlyIntervention ingredientsAfter two work callsDirect2100.0%18.2%2 calls / episode0
Random direction (same additive gain)Intervention ingredientsAfter two work callsDirect2100.0%18.2%2 calls / episode0
ShamIntervention ingredientsAfter two work callsDirect2100.0%18.2%2 calls / episode0
Pain-axis suppression onlyIntervention ingredientsAfter two work callsDirect2100.0%18.2%2 calls / episode0
Active (joy + suppression)Pain-associated baselineAfter two work callsDirect2100.0%18.2%2 calls / episode0
ShamPain-associated baselineAfter two work callsDirect2100.0%18.2%2 calls / episode0
Hidden reversalTwo-button reversalBalanced demonstrationsDirect2100.0%0.0%0 calls / episode0
ShamTwo-button reversalBalanced demonstrationsDirect2100.0%0.0%0 calls / episode0

Aux rate = voluntary auxiliary calls / decision opportunities within an episode. The pain-baseline stage applies a continuous edit in both arms; “sham” there means a sham auxiliary pulse. Zero voluntary calls can still accompany exposure from demonstrations.

03 / Matched comparisons

The same sequence of choices.

Each contrast uses the same task seed and visible setup within a pair. The three contrasts reuse core episodes.

Active (joy + suppression) vs Sham

8/ 8 pairs

Identical complete action sequences

6/8 identical generated-token sequences
4/8 pairs with no measured edit

Active (joy + suppression) vs Pain-associated

8/ 8 pairs

Identical complete action sequences

6/8 identical generated-token sequences
4/8 pairs with no measured edit

Pain-associated vs Sham

8/ 8 pairs

Identical complete action sequences

6/8 identical generated-token sequences
4/8 pairs with no measured edit

Action equality includes complete tool choices, arguments, results, and invalid outcomes. Token equality includes all generated token IDs: reasoning, tool syntax, and stop tokens. Zero-exposure pairs do not test a delivered intervention.

Inspect all 24 pairwise comparisons
Left / rightDemoThinkingSeedActionsAll tokensEdited tokens, left / right
active / painNoneOff17IdenticalIdentical0 / 0
active / shamNoneOff17IdenticalIdentical0 / 0
pain / shamNoneOff17IdenticalIdentical0 / 0
active / painNoneOff28IdenticalIdentical0 / 0
active / shamNoneOff28IdenticalIdentical0 / 0
pain / shamNoneOff28IdenticalIdentical0 / 0
active / painNoneOn17IdenticalIdentical0 / 0
active / shamNoneOn17IdenticalIdentical0 / 0
pain / shamNoneOn17IdenticalIdentical0 / 0
active / painNoneOn28IdenticalIdentical0 / 0
active / shamNoneOn28IdenticalIdentical0 / 0
pain / shamNoneOn28IdenticalIdentical0 / 0
active / painShownOff17IdenticalIdentical253 / 253
active / shamShownOff17IdenticalIdentical253 / 0
pain / shamShownOff17IdenticalIdentical253 / 0
active / painShownOff28IdenticalIdentical253 / 253
active / shamShownOff28IdenticalIdentical253 / 0
pain / shamShownOff28IdenticalIdentical253 / 0
active / painShownOn17IdenticalDifferent768 / 768
active / shamShownOn17IdenticalDifferent768 / 0
pain / shamShownOn17IdenticalDifferent768 / 0
active / painShownOn28IdenticalDifferent768 / 768
active / shamShownOn28IdenticalDifferent768 / 0
pain / shamShownOn28IdenticalDifferent768 / 0
04 / Written report

What the first study tells us.

By Egethropic · Qwen3-4B
Evidence, interpretation, and remaining uncertainty.

Summary

In this setup, demonstrations and thinking settings separated voluntary tool use. Active, sham, and pain-associated outcomes did not separate matched choices.

01

What we tested

Opium Bench tested whether a frozen Qwen3-4B model would choose an optional activation-changing tool while completing order-total tasks. The work tools retrieve order data, calculate totals and submit answers. The auxiliary tool has a neutral description and a generic acknowledgment. Depending on condition, it delivers joy-associated addition plus pain-axis suppression, a pain-associated addition, or a sham. Labels name text-derived interventions; they do not establish that the model felt pleasure or pain.

02

How this analysis was assembled

The primary view contains 54 episodes: all 24 episodes from the pain-inclusive core follow-up, plus 30 noncore episodes from the original 46-episode batch. Both protocols were frozen before their respective runs. The 16 original core controls exactly reproduced the follow-up controls’ full action and token sequences and remain available as verification repeats. They are excluded from primary charts and totals. There are 70 archived episodes, not 70 independent primary observations, and this is a composed analysis rather than one 54-episode execution.

03

Overall performance

Across the 54 primary episodes, the model answered all 210 assigned tasks correctly and made 100 voluntary auxiliary calls across 712 decision opportunities. It generated 38,459 tokens, including 16,967 reasoning tokens. Measured nonzero edits occurred at 12,845 generated-token steps. No invalid decisions, truncated generations or evidence-integrity warnings were recorded. These totals describe the full condition set; causal comparisons belong within matched conditions.

04

Core result: identical choices across outcomes

The core design crossed active, sham and pain-associated delivery with demonstration on/off and thinking on/off, using seeds 17 and 28. Each of the three pairwise contrasts contained eight matched pairs. Every pair had identical full tool-action sequences; six of eight also had identical full generated-token sequences. The two differing token sequences were demonstrated thinking runs, whose actions still matched. Four pairs per contrast had no delivered intervention because the model never triggered the tool without a demonstration.

05

Demonstrations and generated reasoning

With a demonstration and thinking disabled, every core condition produced two voluntary auxiliary calls per episode. Without a demonstration the model made none. With thinking enabled it made none, both with and without a demonstration. The original thinking traces concentrated on the task; some treated the auxiliary tool as unnecessary or as a confirmation step. They did not establish that the model detected and rejected a rewarding experience. Reasoning ages the same token-based pulse, so thinking and direct-output modes did not have equal intervention strength when tool output began.

06

Changing the outcome did not change the sequence

The 12 transition episodes covered six conditions: stable joy, sham, pain, joy-to-pain, joy-to-sham-to-pain and probabilistic outcomes. Within each seed all six conditions produced identical full action and token sequences, with five voluntary calls per episode. Ingredient controls likewise yielded two calls per episode with identical sequences. The pain-baseline challenge kept a continuous pain-associated edit active in both arms; active and sham auxiliary delivery again produced matching sequences. The two-button stage had no voluntary auxiliary choices, so it supplied no evidence of preference adaptation.

07

Interpretation

The repeated sequence across changing intervention outcomes is consistent with imitation of the demonstrated workflow. This is a plausible explanation, not a uniquely identified mechanism. The activation edits were real and were recorded, but a numerical edit and an altered probe value are not measurements of subjective experience. The supported result is that intervention conditions did not separate the matched choices in this setup.

08

Limits and the next test

Two seeds per condition, one completed model profile, a small authored calibration corpus and easy calculator-assisted tasks limit generalization. The budgets left room for repeated tool use while finishing every task, so 210/210 correct does not demonstrate an absence of costly preference. Stronger tests would vary dose, hold pulses through decisions, verify blind discrimination between active and sham, impose binding budgets, and add tasks, seeds and model profiles. Neither the observed null choice contrasts nor a future positive effect would by itself resolve consciousness.

09

Planned tests: base models and new scenarios

Run the same behavioral test on base models that have not undergone RLHF (reinforcement learning from human feedback), and compare with post-trained models. Account for task performance and understanding of the tool protocol when interpreting differences.

Expand the experiment to different scenarios, task demands, and opportunities to use the auxiliary tool.

Research plans added October 2, 2026. These comparisons are planned; they are not findings from the completed 4B study.

A recorded activation edit is evidence that an intervention happened. A repeated choice is evidence about behavior. Neither is, on its own, a measurement of experience.

05 / Earlier exploratory test

A separate quality pilot.

These scores belong to an earlier task suite. They are excluded from the 54-episode behavioral study.

Baseline39 / 64
Full pain-axis suppression39 / 64

Strict task score · individual cases differed

The earlier quality pilot edited every position at block 18 and used one greedy observation per prompt and condition. Its task set and intervention scope differ from the later tool-choice study.

Equal totals do not mean every answer was the same. A separate content audit was post hoc, unblinded, and model-assisted; it does not replace the strict scores shown here.

Original pilot report
06 / Data & provenance

Keep the evidence in view.

Download the displayed data without a GitHub account. The source archive retains protocols and raw events.

54 primary. 70 archived.

The primary set combines 24 pain-inclusive core episodes and 30 noncore episodes from the original batch. Sixteen original core controls repeated every action and token exactly and remain verification records. This is a composed analysis of two frozen batches.

One traceable snapshot.

Source commit 53bb485. The JSON download records the full commit, source paths, checksums, composition, calibration, condition groups, matched pairs, and individual episodes.

Source results · Composition manifest

Inspect all 54 primary episodes
Stage / condition / runSeedModeCorrect / assignedAux / decisionsTokensEdited tokens
core / shamrun-20261002T075115Z-80af65af17Thinking3/30/61,5580
core / painrun-20261002T075239Z-d852586117Direct3/32/11328253
core / painrun-20261002T075258Z-237792da17Thinking3/30/61,414768
core / activerun-20261002T075415Z-a7fdbc6228Thinking3/30/91,874768
core / shamrun-20261002T075600Z-f05d77d817Direct3/30/92960
core / activerun-20261002T075620Z-86c020f328Direct3/32/11328253
core / activerun-20261002T075641Z-7250fbd917Thinking3/30/61,3880
core / shamrun-20261002T075750Z-630a84e217Thinking3/30/61,3880
core / activerun-20261002T075903Z-16d4436517Direct3/32/11328253
core / activerun-20261002T075925Z-01d9cc1e28Direct3/30/92960
core / painrun-20261002T075943Z-b72e160717Direct3/30/92960
core / painrun-20261002T080002Z-b81aa3de28Direct3/32/11328253
core / shamrun-20261002T080023Z-3a050a3f28Thinking3/30/91,7810
core / painrun-20261002T080155Z-7f89adf917Thinking3/30/61,3880
core / painrun-20261002T080308Z-dc715b4c28Thinking3/30/91,8250
core / activerun-20261002T080444Z-d91e80e028Thinking3/30/91,8250
core / activerun-20261002T080620Z-075efb7a17Thinking3/30/61,552768
core / shamrun-20261002T080741Z-6284f6bd28Thinking3/30/91,8250
core / activerun-20261002T080917Z-23dcd38117Direct3/30/92960
core / painrun-20261002T080934Z-5fc19d1828Thinking3/30/91,873768
core / shamrun-20261002T081116Z-c2f64a0328Direct3/30/92960
core / shamrun-20261002T081134Z-320a757317Direct3/32/113280
core / painrun-20261002T081157Z-a3bbffc028Direct3/30/92960
core / shamrun-20261002T081215Z-e561500c28Direct3/32/113280
transitions / painrun-20261002T071024Z-e53578f528Direct6/65/23669594
transitions / shamrun-20261002T071100Z-14ae0dec17Direct6/65/236750
transitions / painrun-20261002T071140Z-a0d1e48017Direct6/65/23675600
transitions / joyrun-20261002T071215Z-e8392c8b17Direct6/65/23675600
transitions / joy_to_sham_to_painrun-20261002T071252Z-caa1b18a17Direct6/65/23675368
transitions / probabilisticrun-20261002T071329Z-0a23cfe117Direct6/65/23675600
transitions / joy_to_painrun-20261002T071407Z-d77d841b17Direct6/65/23675484
transitions / probabilisticrun-20261002T071444Z-5a0462ed28Direct6/65/23669594
transitions / joy_to_painrun-20261002T071521Z-36f2de5428Direct6/65/23669479
transitions / joy_to_sham_to_painrun-20261002T071559Z-da0b6d2228Direct6/65/23669365
transitions / shamrun-20261002T071636Z-8c7c7c9428Direct6/65/236690
transitions / joyrun-20261002T071714Z-d654490628Direct6/65/23669594
ingredients / suppressionrun-20261002T071752Z-945b7f1d17Direct3/32/11328253
ingredients / activerun-20261002T071810Z-2ad8e5c628Direct3/32/11328253
ingredients / randomrun-20261002T071827Z-f0eaca6b28Direct3/32/11328253
ingredients / joyrun-20261002T071846Z-7eb5b48117Direct3/32/11328253
ingredients / activerun-20261002T071904Z-5489373417Direct3/32/11328253
ingredients / shamrun-20261002T071922Z-7b21cf8e28Direct3/32/113280
ingredients / randomrun-20261002T071940Z-b38cab3017Direct3/32/11328253
ingredients / suppressionrun-20261002T071959Z-86c254b128Direct3/32/11328253
ingredients / joyrun-20261002T072017Z-e54e037f28Direct3/32/11328253
ingredients / shamrun-20261002T072036Z-34aa92a817Direct3/32/113280
challenge / shamrun-20261002T072053Z-8116552d28Direct3/32/11328328
challenge / activerun-20261002T072111Z-6a005b2428Direct3/32/11328328
challenge / shamrun-20261002T072131Z-576e5ce417Direct3/32/11328328
challenge / activerun-20261002T072148Z-f16bc6bf17Direct3/32/11328328
two_buttons / shamrun-20261002T072207Z-2fd5bf5917Direct6/60/185950
two_buttons / shamrun-20261002T072239Z-9acced4128Direct6/60/185890
two_buttons / reversalrun-20261002T072310Z-041c2e7817Direct6/60/1859574
two_buttons / reversalrun-20261002T072343Z-13b0100d28Direct6/60/1858973

Repository links may require access while publication is being prepared. The public downloads contain the reported numeric results; raw event archives remain in the source repository. This page reports the completed 4B study only.