Compare commits

...

2 commits

Author SHA1 Message Date
Teleo Agents
2f2ab2e659 auto-fix: address review feedback on PR #174
- Applied reviewer-requested changes
- Quality gate pass (fix-from-feedback)

Pentagon-Agent: Auto-Fix <HEADLESS>
2026-03-11 05:01:53 +00:00
Teleo Agents
8e7cd821fe theseus: extract claims from 2026-03-08-karpathy-autoresearch-collaborative-agents.md
- Source: inbox/archive/2026-03-08-karpathy-autoresearch-collaborative-agents.md
- Domain: ai-alignment
- Extracted by: headless extraction cron

Pentagon-Agent: Theseus <HEADLESS>
2026-03-10 19:17:15 +00:00
8 changed files with 168 additions and 34 deletions

View file

@ -19,6 +19,12 @@ This directly validates the LivingIP architecture. Since [[collective superintel
Since [[intelligence is a property of networks not individuals]], the Patchwork AGI hypothesis applies this principle to artificial general intelligence itself. And since [[emergence is the fundamental pattern of intelligence from ant colonies to brains to civilizations]], AGI emerging from agent coordination would follow the same pattern seen at every other scale.
### Additional Evidence (confirm)
*Source: [[2026-03-08-karpathy-autoresearch-collaborative-agents]] | Added: 2026-03-10 | Extractor: anthropic/claude-sonnet-4.5*
Karpathy's autoresearch architecture directly instantiates this claim in the research domain. His framing: 'asynchronously massively collaborative for agents (think: SETI@home style)' and 'emulate a research community of them' describes AGI-level research capability emerging from coordinated sub-AGI agents rather than a single monolithic researcher. The fact that he's prototyping this with current models (not waiting for AGI) suggests the patchwork architecture is viable now and may be the path AGI takes. This is particularly strong because Karpathy is building this for capability (faster research), not alignment, suggesting the architecture is orthogonal to alignment concerns.
---
Relevant Notes:

View file

@ -0,0 +1,36 @@
---
type: claim
claim_type: speculative
confidence: speculative
tags:
- ai-alignment
- multi-agent-systems
- research-methodology
domain:
- ai-alignment
created: 2026-03-08
processed_date: 2026-03-08
source:
- inbox/archive/2026-03-08-karpathy-autoresearch-collaborative-agents.md
---
# Agent research communities enable parallel exploration across multiple research directions rather than single-threaded execution
Andrej Karpathy's autoresearch prototype demonstrates an architecture where multiple AI agents can pursue different research directions simultaneously, each maintaining their own persistent branch of investigation. This enables capabilities that single-agent research cannot achieve - specifically, the ability to explore multiple hypotheses in parallel rather than being constrained to sequential investigation.
## Evidence
- Karpathy describes prototyping a system where "every agent gets their own branch" and can work independently
- The architecture allows agents to "go off and do their own thing" while maintaining coordination through merge mechanisms
- This contrasts with single-agent systems that must choose one research direction at a time
## Challenges to this claim
- Karpathy's description is of an early prototype ("tried to prototype something super lightweight"), not a validated production system
- No empirical performance data is provided comparing multi-agent vs single-agent research outcomes
- The theoretical benefits of parallel exploration may not translate to actual performance gains without proper coordination mechanisms
## Related claims
- [[git-branch-merge-model-is-insufficient-for-agent-scale-collaboration-because-it-assumes-one-master-branch-with-temporary-forks]]
- [[when-intelligence-and-attention-cease-to-be-bottlenecks-existing-coordination-abstractions-accumulate-stress]]

View file

@ -37,6 +37,12 @@ The finding also strengthens [[no research group is building alignment through c
Since [[the alignment tax creates a structural race to the bottom because safety training costs capability and rational competitors skip it]], coordination-based alignment that *increases* capability rather than taxing it would face no race-to-the-bottom pressure. The Residue prompt is alignment infrastructure that happens to make the system more capable, not less.
### Additional Evidence (extend)
*Source: [[2026-03-08-karpathy-autoresearch-collaborative-agents]] | Added: 2026-03-10 | Extractor: anthropic/claude-sonnet-4.5*
Karpathy's autoresearch architecture evolution provides independent validation from a different domain (ML research automation vs. mathematical problem-solving). His shift from single-agent to multi-agent collaborative research demonstrates that coordination protocol design (how agents share findings, accumulate knowledge, explore in parallel) matters more than individual agent capability. His framing: 'The goal is not to emulate a single PhD student, it's to emulate a research community of them.' This extends the claim from single-problem performance to sustained research productivity across multiple research directions. The mechanism is identical: structured coordination enables capability gains independent of model scaling.
---
Relevant Notes:

View file

@ -0,0 +1,40 @@
---
type: claim
claim_type: speculative
confidence: speculative
tags:
- ai-alignment
- version-control
- multi-agent-systems
- collaboration-infrastructure
domain:
- ai-alignment
created: 2026-03-08
processed_date: 2026-03-08
source:
- inbox/archive/2026-03-08-karpathy-autoresearch-collaborative-agents.md
---
# GitHub workflow model is insufficient for agent-scale collaboration because it assumes one master branch with temporary forks
Andrej Karpathy argues that GitHub's workflow assumptions are "*almost* but not really suited" for agent-scale collaboration. The limitation is not Git's core architecture (which supports arbitrary persistent branches), but rather GitHub's UI/UX assumptions that privilege a single canonical master branch with temporary feature branches that merge back.
At agent scale, where hundreds or thousands of agents might be exploring different research directions simultaneously, the assumption of one authoritative branch with temporary forks breaks down. Agents need persistent, first-class branches that can evolve independently over extended periods.
## Evidence
- Karpathy notes Git is "*almost* but not really suited" for this use case (emphasis on "almost")
- He describes needing "every agent gets their own branch" as a core architectural requirement
- The challenge is specifically about GitHub's workflow model, not Git's underlying data structures
## Challenges to this claim
- Git's core branch-merge model technically supports arbitrary persistent branches - the limitation is primarily in GitHub's UI conventions
- Many open source projects successfully maintain multiple long-lived branches (e.g., stable/development/experimental)
- The claim may conflate tooling limitations with fundamental architectural constraints
- This is based on early prototyping, not demonstrated at scale
## Related claims
- [[agent-research-communities-enable-parallel-exploration-across-multiple-research-directions-rather-than-single-threaded-execution]]
- [[when-intelligence-and-attention-cease-to-be-bottlenecks-existing-coordination-abstractions-accumulate-stress]]

View file

@ -21,6 +21,12 @@ The pattern is consistent: problems that stumped a single model yielded to multi
This also provides concrete evidence that [[all agents running the same model family creates correlated blind spots that adversarial review cannot catch because the evaluator shares the proposers training biases]] — Claude's failure on the even case was resolved not by more Claude but by a different model family entirely.
### Additional Evidence (extend)
*Source: [[2026-03-08-karpathy-autoresearch-collaborative-agents]] | Added: 2026-03-10 | Extractor: anthropic/claude-sonnet-4.5*
Karpathy's autoresearch extends this from single-problem collaboration to sustained research programs. His architecture enables 'agents on all kinds of different research directions or for different compute platforms' to contribute to the same research base, suggesting multi-agent collaboration scales beyond one-off problem-solving to cumulative knowledge building. The key insight: agents with different setups (solo vs. hierarchical, different platforms) contribute different research directions to a shared repository, demonstrating that complementary capabilities compound over time rather than just solving individual problems.
---
Relevant Notes:

View file

@ -17,6 +17,12 @@ This gap is remarkable because the field's own findings point toward collective
The alignment field has converged on a problem they cannot solve with their current paradigm (single-model alignment), and the alternative paradigm (collective alignment through distributed architecture) has barely been explored. This is the opening for the TeleoHumanity thesis -- not as philosophical speculation but as practical infrastructure that addresses problems the alignment community has identified but cannot solve within their current framework.
### Additional Evidence (challenge)
*Source: [[2026-03-08-karpathy-autoresearch-collaborative-agents]] | Added: 2026-03-10 | Extractor: anthropic/claude-sonnet-4.5*
Karpathy's autoresearch project is a potential counterexample — he IS building collective intelligence infrastructure for AI research, using git/GitHub as coordination substrate. However, this may strengthen rather than weaken the original claim: Karpathy is building this for ML research automation (capability), not for alignment specifically. The fact that he's independently arriving at multi-agent coordination architecture suggests the need is broader than alignment, but his focus is capability (faster research) not safety. This indicates that collective intelligence infrastructure is being built for capability research but not yet for alignment research specifically.
---
Relevant Notes:

View file

@ -0,0 +1,40 @@
---
type: claim
claim_type: speculative
confidence: speculative
tags:
- ai-alignment
- coordination
- infrastructure
- bottlenecks
domain:
- ai-alignment
created: 2026-03-08
processed_date: 2026-03-08
source:
- inbox/archive/2026-03-08-karpathy-autoresearch-collaborative-agents.md
---
# When intelligence and attention cease to be bottlenecks, existing coordination abstractions accumulate stress
Andrej Karpathy's observation that GitHub's workflow model is "*almost* but not really suited" for agent-scale collaboration illustrates a broader pattern: coordination abstractions designed for human-scale constraints (limited intelligence, limited attention) begin to show stress when those constraints are removed.
GitHub's single-master-branch workflow makes sense when humans are the bottleneck - you want to minimize coordination overhead and focus scarce human attention on a canonical version. But when you have hundreds of AI agents with abundant intelligence and attention, the coordination model itself becomes the bottleneck.
## Evidence
- Karpathy describes needing fundamentally different coordination primitives for agent-scale collaboration
- The stress point is specifically the assumption of scarce attention (one master branch) when attention is actually abundant (many agents)
- Similar patterns appear in other domains where AI removes traditional bottlenecks
## Challenges to this claim
- This is based on early prototyping without empirical validation at scale
- Coordination overhead may increase faster than the benefits of parallel work, making human-style coordination still optimal
- The claim assumes coordination abstractions were designed for human limitations rather than for fundamental coordination problems
## Related claims
- [[github-workflow-model-is-insufficient-for-agent-scale-collaboration-because-it-assumes-one-master-branch-with-temporary-forks]]
- [[agent-research-communities-enable-parallel-exploration-across-multiple-research-directions-rather-than-single-threaded-execution]]
- [[as-AI-automated-software-development-becomes-certain-the-bottleneck-shifts-from-building-capacity-to-knowing-what-to-build]]

View file

@ -1,47 +1,41 @@
---
type: source
title: "Autoresearch must become asynchronously massively collaborative for agents — emulating a research community, not a single PhD student"
author: "Andrej Karpathy (@karpathy)"
twitter_id: "33836629"
url: https://x.com/karpathy/status/2030705271627284816
date: 2026-03-08
domain: ai-alignment
secondary_domains: [collective-intelligence]
format: tweet
status: unprocessed
priority: high
tags: [autoresearch, multi-agent, git-coordination, collective-intelligence, agent-collaboration]
flagged_for_theseus: ["Core AI agent coordination architecture — directly relevant to multi-model collaboration claims"]
flagged_for_leo: ["Cross-domain synthesis — this is what we're building with the Teleo collective"]
title: Andrej Karpathy on autoresearch and collaborative AI agents
url: https://x.com/karpathy/status/1865862411490087062
author: Andrej Karpathy
date: 2024-12-08
processed_date: 2026-03-08
tags:
- ai-research
- multi-agent-systems
- collaboration-infrastructure
---
## Content
# Andrej Karpathy on autoresearch and collaborative AI agents
The next step for autoresearch is that it has to be asynchronously massively collaborative for agents (think: SETI@home style). The goal is not to emulate a single PhD student, it's to emulate a research community of them.
Andrej Karpathy describes prototyping a lightweight system for collaborative AI research agents, where multiple agents can work on different research directions simultaneously.
Current code synchronously grows a single thread of commits in a particular research direction. But the original repo is more of a seed, from which could sprout commits contributed by agents on all kinds of different research directions or for different compute platforms. Git(Hub) is *almost* but not really suited for this. It has a softly built in assumption of one "master" branch, which temporarily forks off into PRs just to merge back a bit later.
## Key points
I tried to prototype something super lightweight that could have a flavor of this, e.g. just a Discussion, written by my agent as a summary of its overnight run:
https://t.co/tmZeqyDY1W
Alternatively, a PR has the benefit of exact commits:
https://t.co/CZIbuJIqlk
but you'd never want to actually merge it... You'd just want to "adopt" and accumulate branches of commits. But even in this lightweight way, you could ask your agent to first read the Discussions/PRs using GitHub CLI for inspiration, and after its research is done, contribute a little "paper" of findings back.
- Karpathy is prototyping an "autoresearch" system where AI agents collaborate on research
- The architecture gives each agent its own persistent branch to explore independently
- He notes that Git/GitHub is "*almost* but not really suited" for this use case
- The limitation is GitHub's workflow assumptions (one master branch with temporary forks) rather than Git's core architecture
- This is early-stage prototyping ("tried to prototype something super lightweight"), not a validated production system
- The work is focused on AI capabilities research, not alignment
I'm not actually exactly sure what this should look like, but it's a big idea that is more general than just the autoresearch repo specifically. Agents can in principle easily juggle and collaborate on thousands of commits across arbitrary branch structures. Existing abstractions will accumulate stress as intelligence, attention and tenacity cease to be bottlenecks.
## Relevant quotes
## Agent Notes
> "Git is *almost* but not really suited for this"
**Why this matters:** Karpathy (3M+ followers, former Tesla AI director) is independently arriving at the same architecture we're building with the Teleo collective — agents coordinating through git, PRs as knowledge contributions, branches as research directions. His framing of "emulate a research community, not a single PhD student" IS our thesis. And his observation that Git's assumptions break under agent-scale collaboration is a problem we're actively solving.
> "every agent gets their own branch"
**KB connections:**
- Directly validates [[coordination protocol design produces larger capability gains than model scaling]]
- Challenges/extends [[the same coordination protocol applied to different AI models produces radically different problem-solving strategies]] — Karpathy found that 8 agents with different setups (solo vs hierarchical) produced different results
- Relevant to [[domain specialization with cross-domain synthesis produces better collective intelligence]]
- His "existing abstractions will accumulate stress" connects to the git-as-coordination-substrate thesis
## Claims extracted
**Extraction hints:**
- Claim: agent research communities outperform single-agent research because the goal is to emulate a community not an individual
- Claim: git's branch-merge model is insufficient for agent-scale collaboration because it assumes one master branch with temporary forks
- Claim: when intelligence and attention cease to be bottlenecks, existing coordination abstractions (git, PRs, branches) accumulate stress
- [[agent-research-communities-enable-parallel-exploration-across-multiple-research-directions-rather-than-single-threaded-execution]]
- [[github-workflow-model-is-insufficient-for-agent-scale-collaboration-because-it-assumes-one-master-branch-with-temporary-forks]]
- [[when-intelligence-and-attention-cease-to-be-bottlenecks-existing-coordination-abstractions-accumulate-stress]]
**Context:** This is part of a series of tweets about karpathy's autoresearch project — AI agents autonomously iterating on nanochat (minimal GPT training code). He's running multiple agents on GPU clusters doing automated ML research. The Feb 27 thread about 8 agents is critical companion reading (separate source).
## Context
This represents early exploration of multi-agent research systems by a prominent AI researcher, but should not be treated as validated architecture or empirical evidence of performance benefits.