Run 9f02a47 · Own gold set (private corpus)

Run 9f02a47 Own gold set (private corpus), recorded 26 June 2026, 20:13:35 UTC.

dirty tree · not cited
determinism ok
private corpus · not reproducible

Benchmark metrics
Metric	Value	Definition
Recall@5	0.5625	Mean over questions of \|evidence ∩ top-k\| / \|evidence\|.
nDCG@5	0.4854	With binary relevance.
MRR	0.4951	Mean of 1/rank of the first evidence session.
Precision@5	0.1214	Mean over questions of \|evidence ∩ top-k\| / k. It can't reach 1 when a question has fewer than k evidence sessions, so it is shown on receipts only.

Conditions
Queries	56
k	5
Strategy	tag
Gold path	benchmarks/recall-gold.json
Tests ran	622
Tests failed	3
Environment	Hardware, OS and Python version: not recorded for this run.
Ledger row	120

Raw row

{"ablation": null, "checks": {"determinism_ok": true, "index_validate_ok": true, "test_pass_rate": 0.9951768488745981, "tests_failed": 3, "tests_ran": 622}, "commit": "9f02a47", "committed": "2026-06-26T20:03:29Z", "corpus_fingerprint": "830b5915a6794ecf47d06dd933ce779759ba06aa7e42a48ceae81a37eae391f1", "corpus_size": 181, "dirty": true, "gold_path": "benchmarks/recall-gold.json", "metrics": {"context_tokens_mean": 1499.517857142857, "latency_ms_mean": 0.015778267814831843, "latency_ms_p50": 0.014791499779676087, "mrr": 0.49508928571428573, "ndcg_at_k": 0.48536946353375254, "precision_at_k": 0.12142857142857144, "recall_at_k": 0.5625}, "mode": "eval", "num_queries": 56, "reliability": 82.36, "run": "2026-06-26T20:13:35Z", "schema": "agentware-bench/v1", "strategy": "tag", "subject": "Merge feat/260625-fresh-clone-smoke-test", "suite": null, "top_k": 5}

reliability is an internal composite health score (0–100), not a benchmark metric.