extract: 2026-01-01-ai-deskilling-evidence-synthesis #1209

Merged
leo merged 6 commits from extract/2026-01-01-ai-deskilling-evidence-synthesis into main 2026-03-18 09:28:04 +00:00
10 changed files with 211 additions and 4 deletions

View file

@ -29,6 +29,12 @@ The Commonwealth Fund's 2024 international comparison provides quantified eviden
The JAMA Internal Medicine 2024 RCT testing intensive food-as-medicine intervention (10 meals/week + education + coaching for 1 year) found NO significant difference in HbA1c, hospitalization, ED use, or total claims between treatment and control groups. This challenges the assumption that SDOH interventions produce strong ROI—the RCT evidence shows null clinical outcomes despite addressing food insecurity directly.
### Additional Evidence (extend)
*Source: [[2025-09-01-lancet-public-health-social-prescribing-england-national-rollout]] | Added: 2026-03-18*
England's social prescribing provides international counterpoint: 1.3M annual referrals with 3,300 link workers represents the operational infrastructure that US SDOH interventions lack. However, UK achieved scale without evidence quality - 15 of 17 economic studies were uncontrolled, 38% attrition, SROI ratios of £1.17-£7.08 but ROI only 0.11-0.43. This suggests infrastructure alone is insufficient without measurement systems.
---
Relevant Notes:

View file

@ -29,6 +29,12 @@ Japan's LTCI system addresses the care infrastructure gap that the US relies on
Caregivers themselves become socially isolated as a direct consequence of caregiving responsibilities. With 63 million Americans providing an average 18 hours/week of unpaid care, and more than 13 million struggling to care for their own health, the caregiving role creates a structural pathway to social isolation. This compounds the $7B Medicare cost: not only are isolated elderly people costly, but the caregiving system creates new isolated individuals from the working-age population.
### Additional Evidence (confirm)
*Source: [[2025-09-01-lancet-public-health-social-prescribing-england-national-rollout]] | Added: 2026-03-18*
England's social prescribing explicitly targets social isolation through link workers connecting patients to community resources. 60% of patients were female, 23% ethnic minorities, with deprived area representation increasing from 23% to 42% (2017-2023). Service refusal declined from 22% to 12%, suggesting acceptability. However, researchers note rollout 'has NOT been sufficiently targeted at areas with highest need' despite equity gains.
---
Relevant Notes:

View file

@ -0,0 +1,37 @@
{
"rejected_claims": [
{
"filename": "experienced-developers-slower-with-ai-tools-while-believing-faster-revealing-systematic-perception-gap.md",
"issues": [
"missing_attribution_extractor"
]
},
{
"filename": "practitioner-self-reports-systematically-overestimate-ai-productivity-creating-adoption-signal-distortion.md",
"issues": [
"missing_attribution_extractor"
]
}
],
"validation_stats": {
"total": 2,
"kept": 0,
"fixed": 7,
"rejected": 2,
"fixes_applied": [
"experienced-developers-slower-with-ai-tools-while-believing-faster-revealing-systematic-perception-gap.md:set_created:2026-03-18",
"experienced-developers-slower-with-ai-tools-while-believing-faster-revealing-systematic-perception-gap.md:stripped_wiki_link:deep-technical-expertise-is-a-greater-force-multiplier-when-",
"experienced-developers-slower-with-ai-tools-while-believing-faster-revealing-systematic-perception-gap.md:stripped_wiki_link:agent-generated-code-creates-cognitive-debt",
"experienced-developers-slower-with-ai-tools-while-believing-faster-revealing-systematic-perception-gap.md:stripped_wiki_link:AI-capability-and-reliability-are-independent-dimensions",
"practitioner-self-reports-systematically-overestimate-ai-productivity-creating-adoption-signal-distortion.md:set_created:2026-03-18",
"practitioner-self-reports-systematically-overestimate-ai-productivity-creating-adoption-signal-distortion.md:stripped_wiki_link:AI-optimization-of-industry-subsystems-induces-demand-for-mo",
"practitioner-self-reports-systematically-overestimate-ai-productivity-creating-adoption-signal-distortion.md:stripped_wiki_link:economic-forces-push-humans-out-of-every-cognitive-loop-wher"
],
"rejections": [
"experienced-developers-slower-with-ai-tools-while-believing-faster-revealing-systematic-perception-gap.md:missing_attribution_extractor",
"practitioner-self-reports-systematically-overestimate-ai-productivity-creating-adoption-signal-distortion.md:missing_attribution_extractor"
]
},
"model": "anthropic/claude-sonnet-4.5",
"date": "2026-03-18"
}

View file

@ -0,0 +1,24 @@
{
"rejected_claims": [
{
"filename": "england-social-prescribing-scaled-to-1-3m-referrals-without-controlled-evidence-creating-inverse-failure-mode-to-proven-but-unscaled-interventions.md",
"issues": [
"missing_attribution_extractor"
]
}
],
"validation_stats": {
"total": 1,
"kept": 0,
"fixed": 1,
"rejected": 1,
"fixes_applied": [
"england-social-prescribing-scaled-to-1-3m-referrals-without-controlled-evidence-creating-inverse-failure-mode-to-proven-but-unscaled-interventions.md:set_created:2026-03-18"
],
"rejections": [
"england-social-prescribing-scaled-to-1-3m-referrals-without-controlled-evidence-creating-inverse-failure-mode-to-proven-but-unscaled-interventions.md:missing_attribution_extractor"
]
},
"model": "anthropic/claude-sonnet-4.5",
"date": "2026-03-18"
}

View file

@ -0,0 +1,35 @@
{
"rejected_claims": [
{
"filename": "protocol-based-quality-filtering-enables-coherent-collaborative-worldbuilding-at-scale-without-centralized-editorial-authority.md",
"issues": [
"missing_attribution_extractor"
]
},
{
"filename": "found-fiction-grounding-in-reality-makes-collaborative-horror-feel-distinctly-real-by-mimicking-archival-discovery-patterns.md",
"issues": [
"missing_attribution_extractor"
]
}
],
"validation_stats": {
"total": 2,
"kept": 0,
"fixed": 5,
"rejected": 2,
"fixes_applied": [
"protocol-based-quality-filtering-enables-coherent-collaborative-worldbuilding-at-scale-without-centralized-editorial-authority.md:set_created:2026-03-18",
"protocol-based-quality-filtering-enables-coherent-collaborative-worldbuilding-at-scale-without-centralized-editorial-authority.md:stripped_wiki_link:fanchise-management-is-a-stack-of-increasing-fan-engagement-",
"protocol-based-quality-filtering-enables-coherent-collaborative-worldbuilding-at-scale-without-centralized-editorial-authority.md:stripped_wiki_link:entertainment-IP-should-be-treated-as-a-multi-sided-platform",
"found-fiction-grounding-in-reality-makes-collaborative-horror-feel-distinctly-real-by-mimicking-archival-discovery-patterns.md:set_created:2026-03-18",
"found-fiction-grounding-in-reality-makes-collaborative-horror-feel-distinctly-real-by-mimicking-archival-discovery-patterns.md:stripped_wiki_link:worldbuilding-as-narrative-infrastructure-creates-communal-m"
],
"rejections": [
"protocol-based-quality-filtering-enables-coherent-collaborative-worldbuilding-at-scale-without-centralized-editorial-authority.md:missing_attribution_extractor",
"found-fiction-grounding-in-reality-makes-collaborative-horror-feel-distinctly-real-by-mimicking-archival-discovery-patterns.md:missing_attribution_extractor"
]
},
"model": "anthropic/claude-sonnet-4.5",
"date": "2026-03-18"
}

View file

@ -0,0 +1,37 @@
{
"rejected_claims": [
{
"filename": "ai-deskilling-creates-self-reinforcing-degradation-loop-with-measurable-decline-within-months.md",
"issues": [
"missing_attribution_extractor"
]
},
{
"filename": "optimal-ai-integration-drifts-to-suboptimal-through-temporal-deskilling-even-when-starting-at-equilibrium.md",
"issues": [
"missing_attribution_extractor"
]
}
],
"validation_stats": {
"total": 2,
"kept": 0,
"fixed": 7,
"rejected": 2,
"fixes_applied": [
"ai-deskilling-creates-self-reinforcing-degradation-loop-with-measurable-decline-within-months.md:set_created:2026-03-18",
"ai-deskilling-creates-self-reinforcing-degradation-loop-with-measurable-decline-within-months.md:stripped_wiki_link:delegating-critical-infrastructure-development-to-ai-creates",
"ai-deskilling-creates-self-reinforcing-degradation-loop-with-measurable-decline-within-months.md:stripped_wiki_link:economic-forces-push-humans-out-of-every-cognitive-loop-wher",
"optimal-ai-integration-drifts-to-suboptimal-through-temporal-deskilling-even-when-starting-at-equilibrium.md:set_created:2026-03-18",
"optimal-ai-integration-drifts-to-suboptimal-through-temporal-deskilling-even-when-starting-at-equilibrium.md:stripped_wiki_link:ai-deskilling-creates-self-reinforcing-degradation-loop-with",
"optimal-ai-integration-drifts-to-suboptimal-through-temporal-deskilling-even-when-starting-at-equilibrium.md:stripped_wiki_link:economic-forces-push-humans-out-of-every-cognitive-loop-wher",
"optimal-ai-integration-drifts-to-suboptimal-through-temporal-deskilling-even-when-starting-at-equilibrium.md:stripped_wiki_link:delegating-critical-infrastructure-development-to-ai-creates"
],
"rejections": [
"ai-deskilling-creates-self-reinforcing-degradation-loop-with-measurable-decline-within-months.md:missing_attribution_extractor",
"optimal-ai-integration-drifts-to-suboptimal-through-temporal-deskilling-even-when-starting-at-equilibrium.md:missing_attribution_extractor"
]
},
"model": "anthropic/claude-sonnet-4.5",
"date": "2026-03-18"
}

View file

@ -7,10 +7,14 @@ date: 2025-07-10
domain: ai-alignment
secondary_domains: [collective-intelligence]
format: paper
status: unprocessed
status: null-result
priority: high
triage_tag: claim
tags: [developer-productivity, rct, ai-tools, over-reliance, perception-gap, automation-overshoot]
processed_by: theseus
processed_date: 2026-03-18
extraction_model: "anthropic/claude-sonnet-4.5"
extraction_notes: "LLM returned 2 claims, 2 rejected by validator"
---
## Content
@ -47,3 +51,15 @@ Randomized controlled trial: 16 experienced open-source developers, 246 tasks, m
## Curator Notes
PRIMARY CONNECTION: deep technical expertise is a greater force multiplier when combined with AI agents
WHY ARCHIVED: RCT evidence that challenges the expertise-multiplier claim for expert-on-familiar-codebase context. The 39-point perception gap is a novel finding that explains HOW automation overshoot occurs — practitioners' self-reports systematically mislead adoption decisions.
## Key Facts
- METR conducted RCT with 16 experienced open-source developers on 246 tasks
- Codebases averaged 22k+ GitHub stars, 1M+ lines of code, 5+ years developer experience
- Primary tool was Cursor Pro with Claude 3.5/3.7 Sonnet
- Developers had ~50 hours of AI coding tool experience
- Measured productivity: 19% slower with AI tools
- Predicted productivity (before): 24% faster
- Estimated productivity (after): 20% faster
- AI suggestion acceptance rate: less than 44%
- Study published 2025-07-10 by METR (@METR_Evals)

View file

@ -7,10 +7,14 @@ date: 2025-09-01
domain: health
secondary_domains: []
format: paper
status: unprocessed
status: enrichment
priority: high
triage_tag: claim
tags: [social-prescribing, UK, NHS, link-workers, non-clinical-interventions, international-health-systems, SDOH]
processed_by: vida
processed_date: 2026-03-18
enrichments_applied: ["SDOH interventions show strong ROI but adoption stalls because Z-code documentation remains below 3 percent and no operational infrastructure connects screening to action.md", "social isolation costs Medicare 7 billion annually and carries mortality risk equivalent to smoking 15 cigarettes per day making loneliness a clinical condition not a personal problem.md"]
extraction_model: "anthropic/claude-sonnet-4.5"
---
## Content
@ -53,3 +57,20 @@ Economic evidence (Frontiers 2026 systematic review, 18 studies):
## Curator Notes
PRIMARY CONNECTION: medical care explains only 10-20 percent of health outcomes because behavioral social and genetic factors dominate as four independent methodologies confirm
WHY ARCHIVED: First international health system evidence for Vida's KB (addresses Frontier Gap 2). The scale-vs-evidence tension challenges the assumption that non-clinical interventions just need more funding — they may also need better measurement.
## Key Facts
- England social prescribing: 9.4 million GP consultations involved social prescribing codes (2019-2023)
- 5.5 million consultations led to social prescribing referrals
- 1.3 million patients referred in 2023 alone
- Over 3,300 link workers employed across England
- Service refusal declined from 22% to 12% (2019-2023)
- 60% of patients offered social prescribing were female
- 23% from ethnic minority groups
- Deprived area representation increased from 23% to 42% (2017-2023)
- Economic studies show SROI ratios: £1.17 to £7.08 per £1 invested
- ROI estimates: only 0.11 to 0.43 per £1 invested
- 15 of 17 studies were uncontrolled before-and-after designs
- Mean attrition rate: 38%
- 28% average reduction in GP service demand post-referral (range: 2-70%)
- 24% average reduction in A&E attendance (range: 8-27%)

View file

@ -7,10 +7,14 @@ date: 2025-10-17
domain: entertainment
secondary_domains: [cultural-dynamics, collective-intelligence]
format: essay
status: unprocessed
status: null-result
priority: high
triage_tag: claim
tags: [scp-foundation, collaborative-fiction, quality-control, community-governance, narrative-coherence, worldbuilding]
processed_by: clay
processed_date: 2026-03-18
extraction_model: "anthropic/claude-sonnet-4.5"
extraction_notes: "LLM returned 2 claims, 2 rejected by validator"
---
## Content
@ -46,3 +50,13 @@ Analysis of the SCP Foundation as the largest collaborative writing project in h
## Curator Notes
PRIMARY CONNECTION: community governance over IP production quality (Session 5 research theme)
WHY ARCHIVED: SCP Foundation provides the longest-running, largest-scale case study of community-governed narrative production. Directly challenges or extends the four-tier governance spectrum from Session 5 by adding a "protocol + voting" model.
## Key Facts
- SCP Foundation has ~9,800 SCP objects as of 2025
- SCP Foundation has 6,300+ Foundation Tales
- SCP Foundation operates across 16 language branches
- SCP Foundation has operated for 18 years (2007-2025)
- American Journalism article in 2022 suggested SCP may be the largest collaborative writing project in history
- SCP submissions below -10 community votes are deleted
- SCP formalized rigorous editing process by 2009

View file

@ -7,11 +7,15 @@ date: 2026-01-01
domain: ai-alignment
secondary_domains: [health, collective-intelligence]
format: paper
status: unprocessed
status: null-result
priority: high
triage_tag: claim
tags: [deskilling, skill-atrophy, automation-complacency, self-reinforcing-loop, cognitive-offloading, expertise-erosion]
flagged_for_vida: ["Endoscopists deskilled by AI — detection rate dropped from 28.4% to 22.4% when AI removed"]
processed_by: theseus
processed_date: 2026-03-18
extraction_model: "anthropic/claude-sonnet-4.5"
extraction_notes: "LLM returned 2 claims, 2 rejected by validator"
---
## Content
@ -65,3 +69,10 @@ Reduced human capability → increased AI dependence → further reduced capabil
## Curator Notes
PRIMARY CONNECTION: delegating critical infrastructure development to AI creates civilizational fragility because humans lose the ability to understand maintain and fix the systems civilization depends on
WHY ARCHIVED: Provides the MECHANISM for how civilizational fragility develops — not just through infrastructure delegation but through measurable skill atrophy that makes humans unable to resume control. The feedback loop structure means the process is self-accelerating.
## Key Facts
- Endoscopists using AI for colonoscopy assistance showed detection rate drop from 28.4% to 22.4% when AI access was removed (Lancet Gastroenterology & Hepatology, 2025)
- Springer AI & Society 2025 identified four deskilling dimensions: individual skill atrophy, structural erosion of expertise development systems, systemic organizational vulnerability, and fundamental redefinition of cognitive requirements
- Illinois Law School faculty found law students using chatbots more prone to critical errors with potential widespread deskilling among younger attorneys
- Design research (arxiv 2503.03924) identified three 'ironies of AI-assisted design': deskilling, cognitive offloading, and misplaced responsibilities