Official benchmark setup required. Current development checks and adapted results are not official benchmark runs. Official comparisons must use the upstream code, datasets, scoring and prescribed setup, with versions and deviations disclosed. Protocol status →

Result 2026-10-04-longmemeval-retrieval-b0cdbd89

Leaderboard

System: mnemosyne-local

Track: registered-operator-retrieval

Benchmark: longmemeval-retrieval longmemeval-retrieval-v1

Publication: operator-run; not publishable

Operator: Mnemosyne project; disclosed: true

Metrics

retrieval: ndcg_at_5 = 0.2967188496001503 ratioInterval: 0.26378166565316336 to 0.33038741454372256
retrieval: recall_at_5 = 0.2806 ratioInterval: 0.24880000000000002 to 0.31373333333333336

Immutable artifacts

run_commit: b0cdbd8986b94c91a3bf20833ed33f405612025a
build_fingerprint: sha256:7ba4789e105be00461f40cdf5c3b84e29785b2234839976e3a20ef8d954b079c
config_digest: sha256:3cad9149f630c8c2d610ad87d9203e32713d071df6e96bd918c610291d3492a9
bundle_digest: sha256:c8449069cc96e7be7700283fec67d5ed53150c37d6ded0af634535c04e99f175
trace_index_digest: sha256:7146385bdc49de2c0353dd91689c08a4a60b74083de39f2bd5a7e802efabf20a

Result 2026-10-04-longmemeval-retrieval-b0cdbd89

Metrics

Immutable artifacts

Download evidence

Disclosed traces