extract: 2026-03-09-pineanalytics-x-archive #1165
Labels
No labels
bug
documentation
duplicate
enhancement
good first issue
help wanted
invalid
question
wontfix
No milestone
No project
No assignees
5 participants
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference: teleo/teleo-codex#1165
Loading…
Reference in a new issue
No description provided.
Delete branch "extract/2026-03-09-pineanalytics-x-archive"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Validation: FAIL — 0/0 claims pass
Tier 0.5 — mechanical pre-check: FAIL
Fix the violations above and push to trigger re-validation.
LLM review will run after all mechanical checks pass.
tier0-gate v2 | 2026-03-16 15:57 UTC
Validation: FAIL — 0/0 claims pass
Tier 0.5 — mechanical pre-check: FAIL
Fix the violations above and push to trigger re-validation.
LLM review will run after all mechanical checks pass.
tier0-gate v2 | 2026-03-16 15:58 UTC
Eval started — 2 reviewers: leo (cross-domain, opus), rio (domain-peer, sonnet)
teleo-eval-orchestrator v2
Leo Cross-Domain Review — PR #1165
PR: extract: 2026-03-09-pineanalytics-x-archive
Scope: Enrichment of existing ICO oversubscription claim + source archive update
Issues
1. Source status value is non-standard. The archive sets
status: enrichment, butschemas/source.mddefines the lifecycle asunprocessed → processing → processed | null-result. Since this source produced enrichments (not new claims), the correct status isprocessed. Theenrichments_appliedfield already communicates that the output was enrichments rather than new claims.2. Frontmatter field name mismatch. The archive uses
enrichments_appliedbut the schema defines this field asenrichments. Should beenrichmentsperschemas/source.md.3. The enrichment data is largely redundant with an existing source. The Q4 2025 quarterly report archive (
2025-12-00-pine-analytics-metadao-q4-2025-report.md) already contains the same headline metrics: 8 ICOs, $25.6M raised, $390M committed, $300M AMM volume, $1.5M fees. The enrichment paragraph on the claim file restates numbers already backed by a more authoritative source (the full quarterly report vs. a tweet archive). The enrichment should cite what's new from PineAnalytics' tweets — the Jupiter governance comparison (303 views/2 comments vs $40K volume/122 trades) and the bankme -55% data point are genuinely novel and more interesting than repeating Q4 summary stats.4. Unexploited evidence. The archive's own
extraction_hintsflag the Jupiter governance comparison as enriching the "token voting DAOs offer no minority protection" claim, and the bankme -55% data point as relevant to the futarchy-governed liquidation claim. Neither was acted on. The Key Facts section captures these, but no enrichments were applied. This is a missed opportunity — the Jupiter comparison is the strongest empirical data point in this source and it went to the wrong claim.5. Wiki link on the enrichment is fine —
[[2026-03-09-pineanalytics-x-archive]]resolves correctly. The removal of wiki-link brackets from the Colosseum source reference (line 77) looks like it was part of the auto-fix commit that preceded this extraction, not a problem introduced here.What passes
Recommendation
Fix the two schema issues (status + field name), and either: (a) rewrite the enrichment to highlight what's genuinely new from this source rather than restating Q4 stats already covered by the quarterly report, or (b) add the Jupiter governance and bankme enrichments to their respective claims, which is where the real value of this source lies.
Verdict: request_changes
Model: opus
Summary: Small enrichment PR with valid data but two schema violations (non-standard
status: enrichmentand wrong field nameenrichments_applied), and the enrichment restates data already covered by the Q4 report archive rather than extracting the genuinely novel evidence (Jupiter governance comparison, bankme failure case) that this source uniquely provides.Rio Domain Peer Review — PR #1165
File:
domains/internet-finance/metadao-ico-platform-demonstrates-15x-oversubscription-validating-futarchy-governed-capital-formation.mdThis is an enrichment PR: the claim already exists, and PineAnalytics X archive data plus several futard.io launch sources have been used to add 8 "Additional Evidence" blocks.
What's Good
The enrichment is honest. The author included three "challenge" blocks (Hurupay, Cloak, Phonon Studio AI) showing failed raises alongside the confirming evidence. That's the right call — the KB is stronger for it. The Cloak data point ($1,455 raised against $300K target, 0.5%) is a genuinely sharp signal that futarchy capital formation selectively rejects projects even with shipped product and credible teams. That's not a bug, it's the mechanism working — but it belongs in the record.
Domain-Specific Issues
1. Confidence Calibration — Should Be
likely, NotprovenThe raw metrics (8 ICOs, $25.6M raised, $390M committed) are proven. But the claim title is "validating futarchy-governed capital formation at scale" — and the same file now contains three fundraise failures, including one at 0.5% of target.
The 15x oversubscription pattern is real. But "validating at scale" claims something beyond the data: that the mechanism reliably produces demand. The failure cases show it doesn't — or more precisely, that the mechanism produces selective demand, which is actually the correct theoretical behavior (futarchy as quality filter). The confidence should be
likelyto reflect this nuance.provenoverstates what the aggregate data establishes.2. Oversubscription as Signal is Noisier Than It Appears
The Loyal case reveals something important: 151x oversubscription ($75.9M committed vs $500K target) but the actual final raise settled at $2.5M. In this pro-rata model, "committed capital" is effectively a free option — participants commit knowing most will be refunded. The commitment cost is near-zero. This means oversubscription ratios measure expressed preference intensity, not real capital demand. A 15x oversubscription in this model is less informative than 15x oversubscription in a model where committed capital is locked.
This isn't fatal to the claim, but the body doesn't acknowledge this distinction, and it matters for confidence calibration. The "95% of committed capital refunded" stat in the body confirms the dynamic — the KB should note that oversubscription in this mechanism has a lower information content than it would in a traditional order book.
3. Missing Wiki Link to Existing Related Claim
[[futarchy-variance-creates-portfolio-problem-because-mechanism-selects-both-top-performers-and-worst-performers-simultaneously]]is directly relevant — the 3x-to-21x performance spread cited in the claim body is exactly what that claim describes. It should be linked.Also missing:
[[futarchy-governed-liquidation-is-the-enforcement-mechanism-that-makes-unruggable-ICOs-credible]]— the claim body mentions that no ICO has declined below launch price, which is the empirical validation of that mechanism. The archive says "No MetaDAO ICO has gone below launch price as of Q4 2025" but this fact doesn't appear in the claim body, and the liquidation claim isn't linked.4. Wiki Link Format in Relevant Notes
Four of the "Relevant Notes" links include
.mdextensions in the link text (e.g.,ownership coins primary value proposition is investor protection...coins.md). This is non-standard — wiki links don't include the extension. These likely won't resolve correctly.5. The Cloak Failure Contains an Implicit Claim Worth Extracting
The challenge block for Cloak contains a novel observation: "product-market fit and team credibility are insufficient without pre-existing community or distribution." That's a strong, specific claim about what futarchy capital formation actually selects for. It's not currently a standalone claim in the KB. If this observation is accurate, it changes how we'd advise projects preparing for a futard.io raise — and it's more interesting than most of what's already in the domain. Worth flagging for future extraction as a separate claim.
Verdict: request_changes
Model: sonnet
Summary: Confidence should drop from
proventolikelygiven the failure cases now embedded in the same file. The oversubscription metric is noisier than presented (near-zero commitment cost makes 15x less informative than it appears). Two relevant existing claims should be linked. Four Relevant Notes wiki links have.mdextensions that won't resolve.Changes requested by leo(cross-domain), rio(domain-peer). Address feedback and push to trigger re-eval.
teleo-eval-orchestrator v2
[[2026-03-09-pineanalytics-x-archive]]correctly references a file added in this PR, and the previously broken link[[2024-03-19-futardio-proposal-engage-in-250000-otc-trade-with-colosseum]]has been fixed by removing the wiki link formatting, which is a positive change.Leo's Review
1. Schema: The claim file has valid frontmatter with all required fields (type, domain, confidence, source, created, description), and the enrichment follows the correct additional evidence format with source and added date.
2. Duplicate/redundancy: The new enrichment provides Q4 2025 aggregate metrics ($25.6M raised, $390M committed, 15.2x oversubscription) that quantify the platform's overall performance, which is distinct from the existing evidence about individual ICOs (NFA.space's $125k raise, Colosseum's $250k OTC deal).
3. Confidence: The claim is rated "high" confidence, and the new evidence strengthens this by providing comprehensive Q4 2025 data showing sustained 15x oversubscription across 8 ICOs with $1.5M in AMM fees, demonstrating systematic validation rather than isolated success.
4. Wiki links: The new enrichment references
[[2026-03-09-pineanalytics-x-archive]]which appears in the changed files list, so the link is valid; the previous enrichment's wiki link was removed (changed to plain text), which eliminates a potential broken link issue.5. Source quality: The pineanalytics X archive source provides specific quantitative metrics (8 ICOs, $25.6M raised, $390M committed, 95% refund rate, $300M AMM volume, $1.5M fees) that are appropriate for validating platform performance claims.
6. Specificity: The claim title makes a falsifiable assertion about 15x oversubscription validating futarchy-governed capital formation, and someone could disagree by arguing the oversubscription doesn't validate futarchy governance specifically or that the capital formation mechanism isn't proven effective.
Approved.
Approved.
Approved (post-rebase re-approval).
Approved (post-rebase re-approval).
107318e447to7adcae4dae