theseus: extract claims from 2026-04-06-circuit-tracing-production-safety-mitra

- Source: inbox/queue/2026-04-06-circuit-tracing-production-safety-mitra.md
- Domain: ai-alignment
- Claims: 2, Entities: 1
- Enrichments: 1
- Extracted by: pipeline ingest (OpenRouter anthropic/claude-sonnet-4.5)

Pentagon-Agent: Theseus <PIPELINE>

domains/ai-alignment/anthropic-deepmind-interpretability-complementarity-maps-mechanisms-versus-detects-intent.md

@@ -0,0 +1,17 @@
+---
+type: claim
+domain: ai-alignment
+description: The two major interpretability research programs are complementary rather than competing approaches to different failure modes
+confidence: experimental
+source: Subhadip Mitra synthesis of Anthropic and DeepMind interpretability divergence, 2026
+created: 2026-04-07
+title: Anthropic's mechanistic circuit tracing and DeepMind's pragmatic interpretability address non-overlapping safety tasks because Anthropic maps causal mechanisms while DeepMind detects harmful intent
+agent: theseus
+scope: functional
+sourcer: "@subhadipmitra"
+related_claims: ["[[safe AI development requires building alignment mechanisms before scaling capability]]"]
+---
+
+# Anthropic's mechanistic circuit tracing and DeepMind's pragmatic interpretability address non-overlapping safety tasks because Anthropic maps causal mechanisms while DeepMind detects harmful intent
+
+Mitra documents a clear divergence in interpretability strategy: 'Anthropic: circuit tracing → attribution graphs → emotion vectors (all toward deeper mechanistic understanding)' versus 'DeepMind: pivoted to pragmatic interpretability after SAEs underperformed linear probes on harmful intent detection.' The key insight is that these are not competing approaches but complementary ones: 'DeepMind uses what works, Anthropic builds the map. You need both.' Circuit tracing extends from detection to understanding—revealing both *that* deception occurs and *where* in the circuit intervention is possible. DeepMind's pragmatic approach prioritizes immediate detection capability using whatever method works best (linear probes outperformed SAEs for harmful intent). Together they cover more failure modes than either alone: Anthropic provides the causal understanding needed for intervention design, while DeepMind provides the detection capability needed for real-time monitoring. This complementarity suggests that production safety systems will need to integrate both approaches rather than choosing between them.

domains/ai-alignment/circuit-tracing-bottleneck-hours-per-prompt-limits-interpretability-scaling.md

@@ -0,0 +1,17 @@
+---
+type: claim
+domain: ai-alignment
+description: The human analysis time required to understand traced circuits is the limiting factor in deploying mechanistic interpretability at scale
+confidence: experimental
+source: Subhadip Mitra, 2026 analysis documenting Anthropic circuit tracing deployment
+created: 2026-04-07
+title: Circuit tracing requires hours of human effort per prompt which creates a fundamental bottleneck preventing interpretability from scaling to production safety applications
+agent: theseus
+scope: structural
+sourcer: "@subhadipmitra"
+related_claims: ["[[scalable oversight degrades rapidly as capability gaps grow with debate achieving only 50 percent success at moderate gaps]]", "[[formal verification of AI-generated proofs provides scalable oversight that human review cannot match because machine-checked correctness scales with AI capability while human verification degrades]]"]
+---
+
+# Circuit tracing requires hours of human effort per prompt which creates a fundamental bottleneck preventing interpretability from scaling to production safety applications
+
+Mitra documents that 'it currently takes a few hours of human effort to understand the circuits even on prompts with only tens of words.' This bottleneck exists despite Anthropic successfully open-sourcing circuit tracing tools and demonstrating the technique on Claude 3.5 Haiku. The hours-per-prompt constraint means that even with working circuit tracing technology, the human cognitive load of interpreting the results prevents deployment at the scale required for production safety monitoring. This is why SPAR's 'Automating Circuit Interpretability with Agents' project directly targets this bottleneck—attempting to use AI agents to automate the human-intensive analysis work. The constraint is particularly significant because Anthropic did apply mechanistic interpretability in pre-deployment safety assessment of Claude Sonnet 4.5 for the first time, but the scalability question remains unresolved. The bottleneck represents a specific instance of the broader pattern where oversight mechanisms degrade as the volume and complexity of what needs oversight increases.

entities/ai-alignment/spar-automating-circuit-interpretability.md

@@ -0,0 +1,26 @@
+---
+type: entity
+entity_type: research_program
+name: SPAR Automating Circuit Interpretability with Agents
+status: active
+founded: 2025
+parent_org: SPAR (Scalable Alignment Research)
+domain: ai-alignment
+---
+
+# SPAR Automating Circuit Interpretability with Agents
+
+Research program targeting the human analysis bottleneck in mechanistic interpretability by using AI agents to automate circuit interpretation work.
+
+## Overview
+
+SPAR's project directly addresses the documented bottleneck that 'it currently takes a few hours of human effort to understand the circuits even on prompts with only tens of words.' The program attempts to use AI agents to automate the human-intensive analysis work required to interpret traced circuits, potentially enabling interpretability to scale to production safety applications.
+
+## Approach
+
+Applies the role specialization pattern from human-AI mathematical collaboration to interpretability work, where AI agents handle the exploration and analysis while humans provide strategic direction and verification.
+
+## Timeline
+
+- **2025** — Program initiated to address circuit tracing scalability bottleneck
+- **2026-01** — Identified by Mitra as the most direct attempted solution to the hours-per-prompt constraint