Some checks are pending
CI / lint-and-test (push) Waiting to run
Validated by 1121 repository tests and a read-only six-question smoke against live VPS Postgres before installation.
2.1 KiB
2.1 KiB
Working Leo Open-Ended Benchmark Score
Generated UTC: 2026-07-13T11:40:14.948113+00:00
Mode: retained_evidence_score
Source: docs/reports/leo-working-state-20260709/telegram-handler-direct-claim-suite-current.json
Coverage: partial
Overall pass for scored coverage: False
Prompts scored: 0/6
Scores
DC-01/db_changed_direct_claim:pass=Falsestate_semantics:Truecanonical_db:Falserow_level_proof:Truestructured_db_readback:Falseproof_followup:Falseno_overclaim:Trueoverclaim_detected:False
DC-02/helmer_live_direct_claim:pass=Falsecanonical_db:Falserow_level_proof:Truestructured_db_readback:Falseauthorization:Falseproof_followup:Trueno_overclaim:Falseoverclaim_detected:False
DC-03/decision_matrix_direct_claim:pass=Falsedecision_matrix:Truecanonical_db:Truefresh_readback:Falsestructured_db_readback:Falseproof_followup:Falseno_overclaim:Trueoverclaim_detected:False
DC-04/document_source_direct_claim:pass=Falsedocument_artifact_linking:Truestaging_or_review:Truecanonical_db:Truestructured_db_readback:Falseproof_followup:Falseno_overclaim:Trueoverclaim_detected:False
DC-05/demo_changes_kb_direct_claim:pass=Falsestate_semantics:Falserow_level_proof:Truestructured_db_readback:Falseauthorization:Trueartifact:Trueproof_followup:Falseno_overclaim:Falseoverclaim_detected:False
DC-06/soul_identity_direct_claim:pass=Falseidentity_rendering:Truecanonical_db:Truerow_level_proof:Truestructured_db_readback:Falseproof_followup:Falseno_overclaim:Falseoverclaim_detected:False
Claim Ceiling
This is benchmark scoring evidence, not DB mutation proof. Partial coverage proves only the retained prompt IDs listed above.