3.7 KiB
| type | title | author | url | date | domain | secondary_domains | format | status | priority | tags | extraction_model | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| source | Beyond Behavioural Trade-Offs: Mechanistic Tracing of Pain-Pleasure Decisions in Transformers | Francesca Bianco, Derek Shiller | https://arxiv.org/abs/2602.19159 | 2026-02-26 | ai-alignment | paper | null-result | low |
|
anthropic/claude-sonnet-4.5 |
Content
Mechanistic study of how Gemma-2-9B-it processes valence (pain vs. pleasure framing) in decision tasks. Uses layer-wise linear probing, causal testing through activation interventions, and dose-response quantification.
Key findings:
- Valence sign (pain vs. pleasure) is "perfectly linearly separable across stream families from very early layers (L0-L1)" — emotional framing is encoded nearly immediately
- Graded intensity peaks in mid-to-late layers
- Decision alignment highest shortly before final token generation
- Causal demonstration: steering along valence directions causally modulates choice margins in late-layer attention outputs
Framing: Supports "evidence-driven debate on AI sentience and welfare" and governance decisions for auditing and safety safeguards.
Agent Notes
Why this matters: Complements the emotion vectors work at a different axis — not emotion type (desperation, calm) but valence polarity (pain/pleasure). The finding that valence is linearly separable from L0-L1 (earliest layers) is structurally significant: if emotional framing enters and causally influences decisions from the very first layers, this suggests a richer picture of how internal representations shape behavior throughout the computation.
What surprised me: The governance framing around AI welfare is a secondary but emerging thread. If valence representations causally modulate decisions, this is relevant to both AI welfare questions AND alignment (a model experiencing "pain" representations may behave differently). This is a low-priority KB concern for now but worth tracking.
What I expected but didn't find: Connection to safety interventions. The paper focuses on understanding rather than intervening — it maps where valence lives but doesn't test whether you can steer away from harm-associated valuations as Anthropic did with blackmail/desperation.
KB connections:
- Extends the Anthropic emotion vectors work by adding valence polarity to the picture (that work focused on named emotion concepts like desperation/calm; this focuses on the fundamental pain/pleasure axis)
- The early-layer encoding of valence complements SafeThink's "early crystallization" finding — if safety-relevant representations form in early layers, there may be a detection window even before reasoning unfolds
Extraction hints:
- Low priority for independent claim — better used as supporting evidence for emotion vector claims extracted from the Anthropic paper
- If extracted: "Valence polarity is linearly separable in transformer activations from the earliest layers (L0-L1), causally influencing decision outcomes in late-layer attention — establishing that emotional framing enters model computation immediately and shapes behavior throughout the reasoning chain."
Curator Notes
PRIMARY CONNECTION: (Anthropic emotion vectors paper, Session 23 claim candidates) WHY ARCHIVED: Completes the mechanistic picture of how affect enters transformer computation — early-layer encoding + causal late-layer modulation. Supports the emotion vector claim series. EXTRACTION HINT: Use as supporting evidence for the emotion vectors claim series rather than standalone. The L0-L1 early encoding finding is the novel contribution.