Run 42c8822 · Own gold set (private corpus)

Run 42c8822 Own gold set (private corpus), recorded 25 June 2026, 05:29:27 UTC.

dirty tree · not cited
determinism ok
private corpus · not reproducible

Benchmark metrics
Metric	Value	Definition
Recall@5	1.0000	Mean over questions of \|evidence ∩ top-k\| / \|evidence\|.
nDCG@5	0.9530	With binary relevance.
MRR	0.9440	Mean of 1/rank of the first evidence session.
Precision@5	0.2250	Mean over questions of \|evidence ∩ top-k\| / k. It can't reach 1 when a question has fewer than k evidence sessions, so it is shown on receipts only.

Conditions
Queries	56
k	5
Strategy	bm25
Gold path	benchmarks/recall-gold.json
Tests ran	255
Tests failed	1
Environment	Hardware, OS and Python version: not recorded for this run.
Ledger row	63

Raw row

{"ablation": null, "checks": {"determinism_ok": true, "index_validate_ok": true, "test_pass_rate": 0.996078431372549, "tests_failed": 1, "tests_ran": 255}, "commit": "42c8822", "committed": "2026-06-25T05:07:37Z", "dirty": true, "gold_path": "benchmarks/recall-gold.json", "metrics": {"context_tokens_mean": 3799.160714285714, "latency_ms_mean": 5.325559552927318, "latency_ms_p50": 5.301042001519818, "mrr": 0.944047619047619, "ndcg_at_k": 0.9529756257741744, "precision_at_k": 0.22500000000000003, "recall_at_k": 1.0}, "mode": "eval", "num_queries": 56, "reliability": 99.88, "run": "2026-06-25T05:29:27Z", "schema": "agentware-bench/v1", "strategy": "bm25", "subject": "feat(acr): authority confidence reranked items for better search with time bias", "top_k": 5}

reliability is an internal composite health score (0–100), not a benchmark metric.