m3taversal
be8ff41bfe
Wrote sourced_from: into 414 claim files pointing back to their origin source. Backfilled claims_extracted: into 252 source files that were processed but missing this field. Matching uses author+title overlap against claim source: field, validated against 296 known-good pairs from existing claims_extracted. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
19 lines
2.8 KiB
Markdown
19 lines
2.8 KiB
Markdown
---
|
|
type: claim
|
|
domain: ai-alignment
|
|
description: The structural gap between what AI bio benchmarks measure (virology knowledge, protocol troubleshooting) and what real bioweapon development requires (hands-on lab skills, expensive equipment, physical failure recovery) means benchmark saturation does not translate to real-world capability
|
|
confidence: likely
|
|
source: Epoch AI systematic analysis of lab biorisk evaluations, SecureBio VCT design principles
|
|
created: 2026-04-04
|
|
title: Bio capability benchmarks measure text-accessible knowledge stages of bioweapon development but cannot evaluate somatic tacit knowledge, physical infrastructure access, or iterative laboratory failure recovery making high benchmark scores insufficient evidence for operational bioweapon development capability
|
|
agent: theseus
|
|
scope: structural
|
|
sourcer: "@EpochAIResearch"
|
|
related_claims: ["[[AI lowers the expertise barrier for engineering biological weapons from PhD-level to amateur which makes bioterrorism the most proximate AI-enabled existential risk]]", "[[pre-deployment-AI-evaluations-do-not-predict-real-world-risk-creating-institutional-governance-built-on-unreliable-foundations]]"]
|
|
sourced_from:
|
|
- inbox/archive/ai-alignment/2026-03-25-epoch-ai-biorisk-benchmarks-real-world-gap.md
|
|
---
|
|
|
|
# Bio capability benchmarks measure text-accessible knowledge stages of bioweapon development but cannot evaluate somatic tacit knowledge, physical infrastructure access, or iterative laboratory failure recovery making high benchmark scores insufficient evidence for operational bioweapon development capability
|
|
|
|
Epoch AI's systematic analysis identifies four critical capabilities required for bioweapon development that benchmarks cannot measure: (1) Somatic tacit knowledge - hands-on experimental skills that text cannot convey or evaluate, described as 'learning by doing'; (2) Physical infrastructure - synthetic virus development requires 'well-equipped molecular virology laboratories that are expensive to assemble and operate'; (3) Iterative physical failure recovery - real development involves failures requiring physical troubleshooting that text-based scenarios cannot simulate; (4) Stage coordination - ideation through deployment involves acquisition, synthesis, weaponization steps with physical dependencies. Even the strongest benchmark (SecureBio's VCT, which explicitly targets tacit knowledge with questions unavailable online) only measures whether AI can answer questions about these processes, not whether it can execute them. The authors conclude existing evaluations 'do not provide strong evidence that LLMs can enable amateurs to develop bioweapons' despite frontier models now exceeding expert baselines on multiple benchmarks. This creates a fundamental measurement problem: the benchmarks measure necessary but insufficient conditions for capability.
|