a89198c371
- Source: inbox/archive/2024-10-00-patterns-ai-enhanced-collective-intelligence.md - Domain: ai-alignment - Extracted by: headless extraction cron (worker 5) Pentagon-Agent: Theseus <HEADLESS>
2.4 KiB
| type | domain | secondary_domains | description | confidence | source | created | |
|---|---|---|---|---|---|---|---|
| claim | ai-alignment |
|
Humans lose competitive drive when working with AI which causes disengagement before technical alignment mechanisms can function | experimental | Patterns/Cell Press 2024 review citing motivation erosion findings | 2026-03-11 |
AI integration erodes human motivation through competitive drive reduction creating upstream alignment failure
AI integration into collective intelligence systems causes humans to lose "competitive drive" and disengage from tasks, creating an alignment problem upstream of technical alignment concerns. When humans reduce effort or withdraw participation due to AI presence, the entire human-AI system degrades regardless of how well the AI component is technically aligned to human values.
This represents a distinct failure mode from standard alignment concerns: rather than AI pursuing misaligned goals, the system fails because humans stop participating effectively. The motivation erosion effect was observed in citizen science contexts where AI deployment reduced volunteer participation, degrading system performance despite AI capability improvements.
This finding suggests that alignment research focused exclusively on AI behavior may miss critical system-level failures that occur through human behavioral responses to AI integration. If humans disengage before alignment mechanisms activate, technical alignment becomes moot.
Evidence
- Patterns/Cell Press 2024 review documents motivation erosion as a degradation mechanism in AI-enhanced collective intelligence
- Citizen scientist retention problem: AI deployment correlated with reduced volunteer participation
- Effect observed specifically as loss of "competitive drive" rather than capability displacement
Implications
This creates a design constraint for AI-human systems: integration must preserve human motivation and engagement, not just optimize AI performance. Systems that maximize AI capability while eroding human participation will fail at the system level even with perfect technical alignment.
Relevant Notes:
- AI alignment is a coordination problem not a technical problem
- safe AI development requires building alignment mechanisms before scaling capability
- domains/ai-alignment/_map
Topics: