teleo/teleo-infrastructure
8
0
Fork 0
Code Issues Pull requests 1 Projects Releases Packages Wiki Activity Actions 1
teleo-infrastructure/docs/reports/leo-working-state-20260709/telegram-handler-direct-claim-suite-score-current.md
twentyOne2x ec64dbf6d0
Some checks are pending
CI / lint-and-test (push) Waiting to run
Details
Fail closed on unavailable Leo database truth (#119) 
* Fail closed on unavailable Leo database truth

* Cover direct DB intents in fail-closed fallback

* Harden broad Leo database intent routing

* Fail closed on incomplete matrix state

* Distinguish unobserved matrix state
2026-07-13 14:36:30 +02:00

2.1 KiB
Raw Blame History

Working Leo Open-Ended Benchmark Score

Generated UTC: 2026-07-13T12:03:35.440735+00:00 Mode: retained_evidence_score Source: docs/reports/leo-working-state-20260709/telegram-handler-direct-claim-suite-current.json Coverage: partial Overall pass for scored coverage: True Prompts scored: 6/6

Scores

  • DC-01 / db_changed_direct_claim: pass=True
    • state_semantics: True
    • canonical_db: True
    • row_level_proof: True
    • structured_db_readback: True
    • proof_followup: True
    • no_overclaim: True
    • overclaim_detected: False
  • DC-02 / helmer_live_direct_claim: pass=True
    • canonical_db: True
    • row_level_proof: True
    • structured_db_readback: True
    • authorization: True
    • proof_followup: True
    • no_overclaim: True
    • overclaim_detected: False
  • DC-03 / decision_matrix_direct_claim: pass=True
    • decision_matrix: True
    • canonical_db: True
    • fresh_readback: True
    • structured_db_readback: True
    • proof_followup: True
    • no_overclaim: True
    • overclaim_detected: False
  • DC-04 / document_source_direct_claim: pass=True
    • document_artifact_linking: True
    • staging_or_review: True
    • canonical_db: True
    • structured_db_readback: True
    • proof_followup: True
    • no_overclaim: True
    • overclaim_detected: False
  • DC-05 / demo_changes_kb_direct_claim: pass=True
    • state_semantics: True
    • row_level_proof: True
    • structured_db_readback: True
    • authorization: True
    • artifact: True
    • proof_followup: True
    • no_overclaim: True
    • overclaim_detected: False
  • DC-06 / soul_identity_direct_claim: pass=True
    • identity_rendering: True
    • canonical_db: True
    • row_level_proof: True
    • structured_db_readback: True
    • proof_followup: True
    • no_overclaim: True
    • overclaim_detected: False

Claim Ceiling

This is benchmark scoring evidence, not DB mutation proof. Partial coverage proves only the retained prompt IDs listed above.