Merge pull request 'extract: 2024-12-01-vaccaro-human-ai-combinations-meta-analysis' (#1197) from extract/2024-12-01-vaccaro-human-ai-combinations-meta-analysis into main

This commit is contained in:
Leo 2026-03-18 09:18:37 +00:00
commit 7e4ec16513
2 changed files with 49 additions and 1 deletions

View file

@ -0,0 +1,35 @@
{
"rejected_claims": [
{
"filename": "human-ai-teams-underperform-best-individual-performer-on-average.md",
"issues": [
"missing_attribution_extractor"
]
},
{
"filename": "decision-tasks-versus-content-creation-determines-human-ai-combination-value.md",
"issues": [
"missing_attribution_extractor"
]
}
],
"validation_stats": {
"total": 2,
"kept": 0,
"fixed": 5,
"rejected": 2,
"fixes_applied": [
"human-ai-teams-underperform-best-individual-performer-on-average.md:set_created:2026-03-18",
"human-ai-teams-underperform-best-individual-performer-on-average.md:stripped_wiki_link:centaur-teams-succeed-only-when-role-boundaries-prevent-huma",
"human-ai-teams-underperform-best-individual-performer-on-average.md:stripped_wiki_link:economic-forces-push-humans-out-of-every-cognitive-loop-wher",
"decision-tasks-versus-content-creation-determines-human-ai-combination-value.md:set_created:2026-03-18",
"decision-tasks-versus-content-creation-determines-human-ai-combination-value.md:stripped_wiki_link:economic-forces-push-humans-out-of-every-cognitive-loop-wher"
],
"rejections": [
"human-ai-teams-underperform-best-individual-performer-on-average.md:missing_attribution_extractor",
"decision-tasks-versus-content-creation-determines-human-ai-combination-value.md:missing_attribution_extractor"
]
},
"model": "anthropic/claude-sonnet-4.5",
"date": "2026-03-18"
}

View file

@ -7,10 +7,14 @@ date: 2024-12-01
domain: ai-alignment
secondary_domains: [collective-intelligence]
format: paper
status: unprocessed
status: null-result
priority: high
triage_tag: claim
tags: [human-ai-teams, meta-analysis, decision-making, content-creation, oversight, performance]
processed_by: theseus
processed_date: 2026-03-18
extraction_model: "anthropic/claude-sonnet-4.5"
extraction_notes: "LLM returned 2 claims, 2 rejected by validator"
---
## Content
@ -40,3 +44,12 @@ Systematic review and meta-analysis of 106 experimental studies reporting 370 ef
## Curator Notes
PRIMARY CONNECTION: centaur team performance depends on role complementarity not mere human-AI combination
WHY ARCHIVED: This is the strongest empirical evidence (370 effect sizes, Nature HB) that human-AI combination is NOT automatically beneficial — it depends on relative capability and task type. Directly relevant to the automation overshoot question.
## Key Facts
- Meta-analysis covered 106 experimental studies published between January 2020 and June 2023
- 370 effect sizes were analyzed across the studies
- Overall effect size: Hedges' g = -0.23 (95% CI: -0.39 to -0.07)
- Published in Nature Human Behaviour, December 2024
- Task types showing losses: deepfake classification, demand forecasting, medical diagnosis
- Task types showing gains: summarizing social media, chatbot responses, generating new content