Compare runs
Compare memory evidence.
Runs are grouped only when their conditions match. No winner is calculated.
Comparable groups0Same benchmark, data, scoring and budget
Groups with competitors0More than one system measured
Systems0With an eligible result
Outside any group1Records that cannot be compared
How groups are formed.
Rows only appear together when their benchmark, data, scoring, model and budget all match. Each row is one attempt.
No two systems have been measured under matching conditions yet.
A comparison group needs at least two runs with the same benchmark, data, scoring, model and budget. Until then, the development evidence and the attempt history hold what has been measured, and missing measurements are not zero scores.
Outside comparison groups
Records that do not match any group, with the reason.
- 2026-10-04-longmemeval-retrieval-b0cdbd89: legacy comparison metadata unavailable
Dataset fingerprint: sha256:713fdcff46c8363d4ea5e39a904a6c3657db99835d15825082def55ebfbff718