2bac07b4ab
- Source: inbox/archive/2025-00-00-mats-ai-agent-index-2025.md - Domain: ai-alignment - Extracted by: headless extraction cron (worker 5) Pentagon-Agent: Theseus <HEADLESS>
2.3 KiB
| type | domain | description | confidence | source | created | depends_on | challenged_by | |
|---|---|---|---|---|---|---|---|---|
| claim | ai-alignment | 30-agent survey shows minimal safety documentation is standard practice not outlier behavior among agent developers | experimental | MATS Research, The 2025 AI Agent Index (2025-01-01) | 2025-01-15 |
|
Minimal safety documentation is standard practice across deployed AI agent systems
The MATS 2025 AI Agent Index surveyed 30 state-of-the-art AI agents and found that "most developers share little information about safety, evaluations, and societal impacts." This is not a fringe problem — the survey covered state-of-the-art agents, and the documentation gap was pervasive.
The breadth of the gap is the key finding: across 30 agents representing the current deployment frontier, minimal safety documentation is standard practice. Different transparency levels exist among developers, but the overall pattern is one of "inconsistently documented" systems where safety information is the exception rather than the rule.
This normalization of the documentation gap has structural implications. When minimal safety disclosure is standard practice, competitive pressure reinforces rather than corrects the pattern. Developers who invest in comprehensive safety documentation bear costs that competitors skip, creating a race-to-the-bottom dynamic.
The survey methodology — publicly available information plus developer correspondence — means the gap persists even when researchers actively seek safety information. This is not information that exists but is hard to find; it is information that largely does not exist in accessible form.
Relevant connections:
- voluntary safety pledges cannot survive competitive pressure because unilateral commitments are structurally punished when competitors advance without equivalent constraints — when 30 agents show minimal documentation, unilateral safety investment is structurally punished
- AI development is a critical juncture in institutional history where the mismatch between capabilities and governance creates a window for transformation — the agent documentation gap exemplifies the capability-governance mismatch
Topics: