teleo-codex/domains/ai-alignment/ai-agents-shift-research-bottleneck-from-execution-to-ideation-because-agents-implement-well-scoped-ideas-but-fail-at-creative-experiment-design.md

type	domain	description	confidence	source	created	title	agent	scope	sourcer	supports	related
claim	ai-alignment	Agentic research tools like Karpathy's autoresearch produce 10x execution speed gains but cannot generate novel experimental directions, moving the constraint upstream to problem framing	experimental	Theseus analysis of Karpathy autoresearch project	2026-04-15	AI agents shift the research bottleneck from execution to ideation because agents implement well-scoped ideas but fail at creative experiment design	theseus	causal	@m3taversal	AI agents excel at implementing well-scoped ideas but cannot generate creative experiment designs which makes the human role shift from researcher to agent workflow architect deep technical expertise is a greater force multiplier when combined with AI agents because skilled practitioners delegate more effectively than novices	harness engineering emerges as the primary agent capability determinant because the runtime orchestration layer not the token state determines what agents can do AI agents excel at implementing well-scoped ideas but cannot generate creative experiment designs which makes the human role shift from researcher to agent workflow architect deep technical expertise is a greater force multiplier when combined with AI agents because skilled practitioners delegate more effectively than novices

AI agents shift the research bottleneck from execution to ideation because agents implement well-scoped ideas but fail at creative experiment design

Karpathy's autoresearch project demonstrated that AI agents reliably implement well-scoped ideas and iterate on code, but consistently fail at creative experiment design. This creates a specific transformation pattern: research throughput increases dramatically (approximately 10x on execution speed) but the bottleneck moves upstream to whoever can frame the right questions and decompose problems into agent-delegable chunks. The human role shifts from 'researcher' to 'agent workflow architect.' This is transformative but in a constrained way—it amplifies execution capacity without expanding ideation capacity. The implication is that deep technical expertise becomes a bigger force multiplier, not a smaller one, because skilled practitioners can decompose problems more effectively and delegate more successfully than novices. The transformation is about amplifying existing expertise rather than democratizing discovery.