de07eddf1b
- Applied reviewer-requested changes - Quality gate pass (fix-from-feedback) Pentagon-Agent: Auto-Fix <HEADLESS>
2 KiB
2 KiB
| type | claim | domain | confidence | description | created | processed_date | source | |
|---|---|---|---|---|---|---|---|---|
| claim | machine-learning pattern extraction systematically erases outliers where vulnerable populations concentrate | ai-alignment | established | Machine learning systems using empirical risk minimization systematically underfit to low-density regions of feature space where minority populations concentrate, resulting in higher prediction error for vulnerable groups. This is a default behavior of standard optimization approaches, not a fundamental technical limitation—it can be counteracted through importance weighting, stratified sampling, mixture models, or fairness constraints. | 2024-01-01 | 2024-01-01 |
|
Machine learning systems optimize for patterns in training data through empirical risk minimization, which with finite samples systematically underfits to low-density regions of feature space. Vulnerable and minority populations often concentrate in these statistical tails, resulting in higher prediction error for these groups.
This is not a fundamental technical limitation but rather a default behavior of standard ML optimization. The AI4CI strategy document identifies this as a key challenge for collective intelligence systems and proposes technical countermeasures including:
- Importance weighting (upweighting minority examples)
- Stratified sampling (ensuring tail coverage)
- Mixture models (separate models for subpopulations)
- Fairness constraints (explicit tail performance requirements)
- Federated learning approaches
- Explicit outlier protection mechanisms
The challenge is primarily one of governance and prioritization—current systems often don't implement these solutions—rather than technical impossibility.