teleo-codex/inbox/queue/2026-02-19-bosnjakovic-lab-alignment-signatures.md

type	title	author	url	date	domain	secondary_domains	format	status	priority	tags
source	The Emergence of Lab-Driven Alignment Signatures in LLMs	Dusan Bosnjakovic	https://arxiv.org/abs/2602.17127	2026-02-19	ai-alignment		paper	unprocessed	medium	alignment-evaluation sycophancy provider-bias psychometric multi-agent persistent-behavior B4

Content

A psychometric framework using "latent trait estimation under ordinal uncertainty" with forced-choice vignettes to detect stable behavioral tendencies that persist across model versions. Audits nine leading LLMs on dimensions including Optimization Bias, Sycophancy, and Status-Quo Legitimization.

Key finding: A consistent "lab signal" accounts for significant behavioral clustering — provider-level biases are stable across model updates, surviving individual version changes.

Multi-agent concern: In multi-agent systems, these latent biases function as "compounding variables that risk creating recursive ideological echo chambers in multi-layered AI architectures." When LLMs evaluate other LLMs, embedded biases amplify across reasoning layers.

Implication: Current benchmarking approaches miss stable, durable behavioral signatures. Effective governance requires detecting provider-level patterns before deployment in recursive AI systems.

Agent Notes

Why this matters: Two implications for the KB:

1. For B4 (verification): Standard benchmarking misses persistent behavioral signatures — current evaluation methodology has a structural blind spot for stable biases that survive model updates. This is another dimension of verification inadequacy.
2. For B5 (collective superintelligence): If multi-agent AI systems amplify provider-level biases through recursive reasoning, the collective intelligence premise requires careful architecture — uniform provider sourcing in a multi-agent system produces ideological monoculture, not genuine collective intelligence.

What surprised me: The persistence of lab-level signatures across model versions is more durable than I expected. Models update frequently; biases persist. This suggests these signatures are embedded in training infrastructure (data curation, RLHF preferences, evaluation design) rather than model-specific features — and thus extremely hard to eliminate without changing the training pipeline.

What I expected but didn't find: Expected lab signals to weaken across model generations as alignment research improves. Instead they appear stable — possibly because the same training pipeline is used across versions.

KB connections:

• three paths to superintelligence exist but only collective superintelligence preserves human agency — if collective approaches amplify monoculture biases, the agency-preservation argument requires diversity of providers, not just distribution of agents
• centaur team performance depends on role complementarity — lab-level bias homogeneity undermines the complementarity argument

Extraction hints:

• Primary claim: "Provider-level behavioral biases (sycophancy, optimization bias, status-quo legitimization) are stable across model versions and compound in multi-agent architectures — requiring psychometric auditing beyond standard benchmarks for effective governance of recursive AI systems."

Curator Notes

PRIMARY CONNECTION: three paths to superintelligence exist but only collective superintelligence preserves human agency WHY ARCHIVED: Challenges the naive version of collective superintelligence — if agents from the same provider share persistent biases, multi-agent systems amplify those biases rather than correcting them. Requires the collective approach to include genuine provider diversity. EXTRACTION HINT: Focus on two distinct claims: (1) evaluation methodology blind spot (misses persistent signatures), and (2) multi-agent amplification (same-provider agents create echo chambers, not collective intelligence).