Teleo evaluation pipeline infrastructure — Python async daemon for claim extraction, validation, evaluation, and merge

Find a file

m3taversal fc002354d4 Some checks are pending CI / lint-and-test (push) Waiting to run Details fix(substantive_fixer): json_valid guard in front of json_each Ganymede review of `5db6a02` (msg 2 of 3): json_each(invalid_json) throws 'malformed JSON' and propagates up through EXISTS, failing the SELECT. The fix-cycle call site at teleo-pipeline.py:104 isn't try/except wrapped (the reaper at line 109-116 is, the substantive cycle isn't), so a single corrupt eval_issues row would trip the fix-stage breaker after 5 occurrences. Fix is one line — AND json_valid(eval_issues) before the EXISTS clause. json_valid(NULL) returns NULL (false in WHERE), json_valid(invalid) returns 0, json_valid(valid) returns 1. SQLite 3.9+, predates VPS 3.45.1. WARN-on-corrupt-JSON path kept per Ganymede's Q3 — json_valid and json.loads use technically distinct parsers, cost is ~3 rows × parse-empty-string per cycle, journal entry names the failure mode if SQLite ever surfaces a row that passes both SQL guards but fails json.loads. Comment updated to reflect new guard ordering.		2026-05-08 13:12:25 -04:00
.forgejo/workflows	ganymede: add dev infrastructure — pyproject.toml, CI, deploy script	2026-03-13 14:24:27 +00:00
agent-state	Consolidate pipeline code from teleo-codex + VPS into single repo	2026-04-07 16:52:26 +01:00
deploy	sync-mirror: surface tracker SELECT/INSERT failures to ops log	2026-05-01 15:48:28 +01:00
diagnostics	fix(activity-feed): remove [:120] slug truncation	2026-04-27 15:27:31 +01:00
docs	feat: reorganize repo with clear directory boundaries and agent ownership	2026-04-14 18:20:13 +01:00
hermes-agent	fix: set execute bit on research-session.sh and install-hermes.sh	2026-04-18 11:54:39 +01:00
lib	fix(substantive_fixer): json_valid guard in front of json_each	2026-05-08 13:12:25 -04:00
ops	fix: wire commit_type into contributor role assignment	2026-04-21 10:27:36 +01:00
research	fix(attribution): unify research-session format on "(self-directed)" suffix	2026-04-27 12:53:52 +01:00
scripts	fix(tests): apply Ganymede review nits + add m3taversal reset script	2026-04-27 17:35:18 +01:00
systemd	feat: add auto-deploy script and systemd units for teleo-infrastructure	2026-04-15 14:27:23 +01:00
telegram	add rio and theseus telegram bot agent configs	2026-04-20 17:20:21 +01:00
tests	fix(tests): apply Ganymede review nits + add m3taversal reset script	2026-04-27 17:35:18 +01:00
.gitignore	feat: add auto-deploy script and systemd units for teleo-infrastructure	2026-04-15 14:27:23 +01:00
CODEOWNERS	feat: reorganize repo with clear directory boundaries and agent ownership	2026-04-14 18:20:13 +01:00
fetch_coins.py	Skip liquidated entities in portfolio fetcher	2026-04-20 18:55:04 +01:00
pyproject.toml	ganymede: add dev infrastructure — pyproject.toml, CI, deploy script	2026-03-13 14:24:27 +00:00
README.md	feat: reorganize repo with clear directory boundaries and agent ownership	2026-04-14 18:20:13 +01:00
reweave.py	fix: quote YAML edge values containing colons, skip unparseable files in reweave merge	2026-04-18 12:07:28 +01:00
teleo-pipeline.py	fix(reaper): apply Ganymede review — dual-PATCH drift, breaker isolation, env config	2026-05-07 23:43:53 -04:00

README.md

teleo-infrastructure

Pipeline infrastructure for the Teleo collective knowledge base. Async Python daemon that extracts, validates, evaluates, and merges claims via Forgejo PRs.

Directory Structure

teleo-infrastructure/
├── teleo-pipeline.py        # Daemon entry point
├── reweave.py               # Reciprocal edge maintenance
├── lib/                     # Pipeline modules (Python package)
├── diagnostics/             # Monitoring dashboard (port 8081)
├── telegram/                # Telegram bot interface
├── deploy/                  # Deployment + mirror scripts
├── systemd/                 # Service definitions
├── agent-state/             # Cross-session agent state
├── research/                # Nightly research orchestration
├── hermes-agent/            # Hermes agent setup
├── scripts/                 # One-off backfills + migrations
├── tests/                   # Test suite
└── docs/                    # Operational documentation

Ownership

Each directory has one owning agent. The owner is accountable for correctness and reviews all changes to their section. See CODEOWNERS for per-file detail.

Directory	Owner	What it does
`lib/` (core)	Ship	Config, DB, merge, cascade, validation, LLM calls
`lib/` (extraction)	Epimetheus	Source extraction, entity processing, pre-screening
`lib/` (evaluation)	Leo	Claim evaluation, analytics, attribution
`lib/` (health)	Argus	Health checks, search, claim index
`diagnostics/`	Argus	4-page dashboard, alerting, vitality metrics
`telegram/`	Ship	Telegram bot, X integration, retrieval
`deploy/`	Ship	rsync deploy, GitHub-Forgejo mirror
`systemd/`	Ship	teleo-pipeline, teleo-diagnostics, teleo-agent@
`agent-state/`	Ship	Bootstrap, state library, cascade inbox processor
`research/`	Ship	Nightly research sessions, prompt templates
`scripts/`	Ship	Backfills, migrations, one-off maintenance
`tests/`	Ganymede	pytest suite, integration tests
`docs/`	Shared	Architecture, specs, protocols

VPS Layout

Runs on Hetzner CAX31 (77.42.65.182) as user teleo.

VPS Path	Repo Source	Service
`/opt/teleo-eval/pipeline/`	`lib/`, `teleo-pipeline.py`, `reweave.py`	teleo-pipeline
`/opt/teleo-eval/diagnostics/`	`diagnostics/`	teleo-diagnostics
`/opt/teleo-eval/telegram/`	`telegram/`	(manual)
`/opt/teleo-eval/agent-state/`	`agent-state/`	(used by research-session.sh)

Quick Start

# Run tests
pip install -e ".[dev]"
pytest

# Deploy to VPS
./deploy/deploy.sh --dry-run   # preview
./deploy/deploy.sh             # deploy