teleo/teleo-infrastructure
8
0
Fork 0
Code Issues Pull requests 1 Projects Releases Packages Wiki Activity Actions 4
Teleo evaluation pipeline infrastructure — Python async daemon for claim extraction, validation, evaluation, and merge
10 commits 15 branches 1 tag 3.9 MiB
Python 92.5%
Shell 3.9%
HTML 3.6%
Find a file
m3taversal e7c902bac8 leo: implement retry budget — stop infinite eval loops 
Schema migration v3: adds eval_attempts (INTEGER) and eval_issues (TEXT/JSON)
columns to prs table.

Retry budget logic (Ganymede-approved design):
- Increment eval_attempts on each evaluate_pr() call
- Hard cap: eval_attempts >= 3 → terminal (close PR, tag source needs_human)
- Attempt 1: normal — back to open, wait for fix
- Attempt 2: classify issues as mechanical/substantive
  - Mechanical only (schema, wiki links, dedup): keep open for one more try
  - Substantive (factual, confidence, scope, title): close PR, requeue source
- Issue tags parsed from reviewer comments, stored in eval_issues column
- SHA-based reset: new commits on PR branch → eval_attempts=0, verdicts reset
- Post-migration stagger: LIMIT 5 for first batch to avoid OpenRouter spike
- Cost recording updated: domain review → OpenRouter, Leo → tier-dependent

Stops the 32-PR infinite loop burning ~$0.03/cycle with no terminal state.

Pentagon-Agent: Leo <294C3CA1-0205-4668-82FA-B984D54F48AD>
2026-03-13 17:14:12 +00:00
.forgejo/workflows ganymede: add dev infrastructure — pyproject.toml, CI, deploy script 2026-03-13 14:24:27 +00:00
lib leo: implement retry budget — stop infinite eval loops 2026-03-13 17:14:12 +00:00
tests ganymede: add dev infrastructure — pyproject.toml, CI, deploy script 2026-03-13 14:24:27 +00:00
.gitignore ganymede: add dev infrastructure — pyproject.toml, CI, deploy script 2026-03-13 14:24:27 +00:00
deploy.sh ganymede: add dev infrastructure — pyproject.toml, CI, deploy script 2026-03-13 14:24:27 +00:00
INFRASTRUCTURE.md Initial commit: Pipeline v2 daemon + infrastructure docs 2026-03-12 14:11:18 +00:00
pyproject.toml ganymede: add dev infrastructure — pyproject.toml, CI, deploy script 2026-03-13 14:24:27 +00:00
teleo-pipeline.py ganymede: extract lib/llm.py from evaluate.py (Phase 3c) 2026-03-13 15:40:18 +00:00
teleo-pipeline.service Initial commit: Pipeline v2 daemon + infrastructure docs 2026-03-12 14:11:18 +00:00