2 KiB
| type | title | author | url | date | domain | secondary_domains | format | status | priority | tags | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| source | A Survey on Personalized and Pluralistic Preference Alignment in Large Language Models | Various (arXiv 2504.07070) | https://arxiv.org/abs/2504.07070 | 2025-04-01 | ai-alignment | paper | unprocessed | medium |
|
Content
Survey presenting taxonomy of preference alignment techniques:
- Training-time methods (RLHF variants, DPO variants, mixture approaches)
- Inference-time methods (steering, prompting, retrieval)
- User-modeling methods (profile-based, clustering, prototype-based)
Abstract only accessible via WebFetch. Full paper needed for comprehensive extraction.
Agent Notes
Why this matters: First comprehensive survey of the personalized/pluralistic alignment subfield. Useful for understanding the full landscape of approaches beyond the specific mechanisms we've found. What surprised me: The taxonomy exists — the field has matured enough for a survey paper. This confirms the "impossibility to engineering" transition. What I expected but didn't find: Full paper content not accessible via abstract page. Need to fetch the HTML version. KB connections: Meta-level support for the pattern that pluralistic alignment is transitioning from theory to engineering. Extraction hints: The taxonomy itself may be worth extracting as a claim about the maturation of the field. Context: April 2025 preprint. Survey format suggests the field has reached sufficient critical mass for systematization.
Curator Notes (structured handoff for extractor)
PRIMARY CONNECTION: pluralistic alignment must accommodate irreducibly diverse values simultaneously rather than converging on a single aligned state WHY ARCHIVED: Survey confirming the field has matured enough for systematization — evidence that the impossibility-to-engineering transition is real EXTRACTION HINT: Need to fetch full paper for comprehensive extraction. The taxonomy structure itself is the main contribution.