SOURCE COVERAGE · 30 OCTOBER 2026
Every comparison cell,
accounted for.
123 cells have recorded scores. 253 explicitly identify a result absent from the cited source catalog. 29 previously empty cells now have sourced numbers.
Mnemosyne
Not reported in cited sources: LoCoMo, BEAM 1M, BEAM 10M.
Sources included in this catalog (11)
- Mnemetric LongMemEval retrieval report — source recorded 2026-10-06
- Mnemetric LongMemEval-S answer-accuracy runs, 8 and 9 Oct 2026 — source recorded 2026-10-06
- Mnemetric LongMemEval-S answer-accuracy runs, 8 and 9 Oct 2026 — source recorded 2026-10-06
- Mnemetric LongMemEval-S answer-accuracy runs, 8 and 9 Oct 2026 — source recorded 2026-10-06
- Mnemetric LongMemEval-S answer-accuracy runs, 8 and 9 Oct 2026 — source recorded 2026-10-06
- Mnemetric LongMemEval-S answer-accuracy runs, 8 and 9 Oct 2026 — source recorded 2026-10-06
- Mnemetric graph-retrieval run, 2026-10-08 — source recorded 2026-10-06
- Mnemetric HotpotQA retrieval report — source recorded 2026-10-06
- Mnemetric 2WikiMultiHopQA retrieval report — source recorded 2026-10-06
- Mnemetric MuSiQue retrieval report — source recorded 2026-10-06
- Mnemosyne LongMemEval-S results, October 28–29, 2026 — source recorded 2026-10-30
What the status means
“Not reported” means this catalog’s retained claims and supplementary sources do not supply a matching figure. It does not mean zero, a failed benchmark, or that a result cannot exist elsewhere. We do not substitute a retrieval score for answer accuracy or a 100K-token result for a 1M-token result.
The source list includes historical references with their recorded dates, plus new primary reports reviewed on October 30. Measurements retain the publisher and test setup; another company’s reproduction is identified as such. No new model inference ran for this update.
ByteRover
Not reported in cited sources: BEAM 1M, BEAM 10M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (2)
- ByteRover README — source recorded 2026-10-06
- ByteRover README — source recorded 2026-10-06
Chronos
Not reported in cited sources: LoCoMo, BEAM 1M, BEAM 10M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (1)
- Chronos paper, arXiv 2603.16862 — source recorded 2026-10-06
Hindsight
Not reported in cited sources: LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (3)
- Agent Memory Benchmark, run by Vectorize (maker of Hindsight) — source recorded 2026-10-06
- Hindsight benchmarks page — source recorded 2026-10-06
- OmniMemEval reproduced result snapshot — source recorded 2026-10-30
Mem0
Not reported in cited sources: HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (12)
- Mem0 README — source recorded 2026-10-06
- Mem0 README — source recorded 2026-10-06
- Mem0 README — source recorded 2026-10-06
- Mem0 README — source recorded 2026-10-06
- Mem0 paper, arXiv 2504.19413 — source recorded 2026-10-06
- LightMem README — source recorded 2026-10-06
- LightMem README — source recorded 2026-10-06
- LightMem README — source recorded 2026-10-06
- TiMem paper, arXiv 2601.02845 — source recorded 2026-10-06
- MemMachine v0.2 LoCoMo blog post, December 2025 — source recorded 2026-10-06
- LiCoMemory paper, arXiv 2511.01448 — source recorded 2026-10-30
- OmniMemEval reproduced result snapshot — source recorded 2026-10-30
Mastra
Not reported in cited sources: LoCoMo, BEAM 10M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (3)
- Chronos paper, arXiv 2603.16862 — source recorded 2026-10-06
- Mastra Observational Memory research — source recorded 2026-10-30
- Mastra BEAM research, October 29, 2026 — source recorded 2026-10-30
MemMachine
Not reported in cited sources: BEAM 1M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (4)
- MemMachine v0.2 LoCoMo blog post, December 2025 — source recorded 2026-10-06
- MemMachine LoCoMo blog post, September 2025 — source recorded 2026-10-06
- MemMachine paper, arXiv 2604.04853 — source recorded 2026-10-30
- OmniMemEval reproduced result snapshot — source recorded 2026-10-30
gbrain
Not reported in cited sources: LoCoMo, BEAM 1M, BEAM 10M, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (5)
- gbrain-evals README — source recorded 2026-10-06
- gbrain-evals README — source recorded 2026-10-06
- gbrain-evals README — source recorded 2026-10-06
- gbrain-evals README — source recorded 2026-10-06
- gbrain-evals current results — source recorded 2026-10-30
Honcho
Not reported in cited sources: LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (2)
- Plastic Labs, Benchmarking Honcho — source recorded 2026-10-06
- Honcho evaluation site — source recorded 2026-10-06
ReMe
Not reported in cited sources: LoCoMo, BEAM 10M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (3)
- ReMe README — source recorded 2026-10-06
- ReMe README — source recorded 2026-10-06
- ReMe README — source recorded 2026-10-06
MemOS
Not reported in cited sources: BEAM 1M, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (9)
- MemOS README — source recorded 2026-10-06
- MemOS README — source recorded 2026-10-06
- MemOS README — source recorded 2026-10-06
- MemOS README — source recorded 2026-10-06
- MemOS README — source recorded 2026-10-06
- TiMem paper, arXiv 2601.02845 — source recorded 2026-10-06
- MemOS LifeBench paper, arXiv 2603.03781 — source recorded 2026-10-06
- LiCoMemory paper, arXiv 2511.01448 — source recorded 2026-10-30
- OmniMemEval reproduced result snapshot — source recorded 2026-10-30
SmartSearch
Not reported in cited sources: BEAM 1M, BEAM 10M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (2)
- SmartSearch paper, arXiv 2603.15599 — source recorded 2026-10-06
- SmartSearch paper, arXiv 2603.15599 — source recorded 2026-10-30
CORE
Not reported in cited sources: LongMemEval, BEAM 1M, BEAM 10M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (1)
- CORE README — source recorded 2026-10-06
Memora
Not reported in cited sources: BEAM 1M, BEAM 10M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (2)
- Memora paper, arXiv 2602.03315 — source recorded 2026-10-06
- Memora paper, arXiv 2602.03315 — source recorded 2026-10-30
Memori
Not reported in cited sources: BEAM 1M, BEAM 10M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (2)
- Memori README — source recorded 2026-10-06
- OmniMemEval reproduced result snapshot — source recorded 2026-10-30
supermemory
Not reported in cited sources: BEAM 1M, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (6)
- supermemory README — source recorded 2026-10-06
- supermemory README — source recorded 2026-10-06
- supermemory README — source recorded 2026-10-06
- supermemory README — source recorded 2026-10-06
- supermemory paper, arXiv 2512.12818 — source recorded 2026-10-06
- OmniMemEval reproduced result snapshot — source recorded 2026-10-30
EMem-G
Not reported in cited sources: BEAM 1M, BEAM 10M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (2)
- EMem-G paper, arXiv 2511.17208 — source recorded 2026-10-06
- EMem-G paper, arXiv 2511.17208 — source recorded 2026-10-30
Nemori
Not reported in cited sources: BEAM 1M, BEAM 10M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (2)
- Nemori README — source recorded 2026-10-06
- Nemori paper, arXiv 2508.03341 — source recorded 2026-10-06
EverMemOS
Not reported in cited sources: BEAM 1M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (3)
- SmartSearch paper, arXiv 2603.15599 — source recorded 2026-10-06
- EverMemOS paper, arXiv 2601.02163 — source recorded 2026-10-30
- OmniMemEval reproduced result snapshot — source recorded 2026-10-30
Cognee
Not reported in cited sources: BEAM 1M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (4)
- Cognee README — source recorded 2026-10-06
- Cognee README — source recorded 2026-10-06
- Agent Memory Benchmark, run by Vectorize (maker of Hindsight) — source recorded 2026-10-06
- OmniMemEval reproduced result snapshot — source recorded 2026-10-30
TiMem
Not reported in cited sources: BEAM 1M, BEAM 10M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (2)
- TiMem paper, arXiv 2601.02845 — source recorded 2026-10-06
- TiMem paper, arXiv 2601.02845 — source recorded 2026-10-30
CoM
Not reported in cited sources: BEAM 1M, BEAM 10M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (2)
- Chain-of-Memory paper, arXiv 2601.14287 — source recorded 2026-10-06
- CoM paper, arXiv 2601.14287 — source recorded 2026-10-30
Memobase
Not reported in cited sources: LongMemEval, BEAM 1M, BEAM 10M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (1)
- MemMachine LoCoMo blog post, September 2025 — source recorded 2026-10-06
Zep
Not reported in cited sources: BEAM 1M, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (5)
- Mem0 paper, arXiv 2504.19413 — source recorded 2026-10-06
- Zep blog, corrected LoCoMo result — source recorded 2026-10-06
- Zep paper, arXiv 2501.13956, Table 2 — source recorded 2026-10-06
- LiCoMemory paper, arXiv 2511.01448 — source recorded 2026-10-30
- OmniMemEval reproduced result snapshot — source recorded 2026-10-30
HyMem
Not reported in cited sources: BEAM 1M, BEAM 10M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (2)
- HyMem paper, arXiv 2602.13933 — source recorded 2026-10-06
- HyMem paper, arXiv 2602.13933 — source recorded 2026-10-30
Letta
Not reported in cited sources: BEAM 1M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (2)
- Letta, Benchmarking AI agent memory — source recorded 2026-10-06
- OmniMemEval reproduced result snapshot — source recorded 2026-10-30
LiCoMemory
Not reported in cited sources: BEAM 1M, BEAM 10M, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (2)
- LiCoMemory paper, arXiv 2511.01448 — source recorded 2026-10-06
- LiCoMemory paper, arXiv 2511.01448 — source recorded 2026-10-30
ENGRAM
Not reported in cited sources: BEAM 1M, BEAM 10M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (2)
- ENGRAM paper, arXiv 2511.12960 — source recorded 2026-10-06
- ENGRAM paper, arXiv 2511.12960 — source recorded 2026-10-30
A-Mem
Not reported in cited sources: BEAM 1M, BEAM 10M, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (4)
- Mem0 paper, arXiv 2504.19413 — source recorded 2026-10-06
- LightMem README — source recorded 2026-10-06
- TiMem paper, arXiv 2601.02845 — source recorded 2026-10-06
- LiCoMemory paper, arXiv 2511.01448 — source recorded 2026-10-30
MemoryOS
Not reported in cited sources: BEAM 1M, BEAM 10M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (3)
- LightMem README — source recorded 2026-10-06
- LightMem README — source recorded 2026-10-06
- TiMem paper, arXiv 2601.02845 — source recorded 2026-10-06
LangMem
Not reported in cited sources: BEAM 1M, BEAM 10M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (2)
- Mem0 paper, arXiv 2504.19413 — source recorded 2026-10-06
- LangMem paper, arXiv 2601.14287 — source recorded 2026-10-30
OpenAI memory
Not reported in cited sources: LongMemEval, BEAM 1M, BEAM 10M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (1)
- Mem0 paper, arXiv 2504.19413 — source recorded 2026-10-06
LIGHT
Not reported in cited sources: LongMemEval, LoCoMo, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (1)
- LIGHT paper, arXiv 2510.27246 — source recorded 2026-10-06
MemoryBank
Not reported in cited sources: BEAM 1M, BEAM 10M, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (3)
- TiMem paper, arXiv 2601.02845 — source recorded 2026-10-06
- MemoryBank paper, arXiv 2601.02845 — source recorded 2026-10-30
- LiCoMemory paper, arXiv 2511.01448 — source recorded 2026-10-30
MemPalace
Not reported in cited sources: LongMemEval, LoCoMo, BEAM 1M, BEAM 10M, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (8)
- MemPalace README — source recorded 2026-10-06
- MemPalace README — source recorded 2026-10-06
- MemPalace README — source recorded 2026-10-06
- MemPalace README — source recorded 2026-10-06
- MemPalace README — source recorded 2026-10-06
- MemPalace README — source recorded 2026-10-06
- gbrain-evals README — source recorded 2026-10-06
- gbrain-evals README — source recorded 2026-10-06
HippoRAG 2
Not reported in cited sources: LongMemEval, LoCoMo, BEAM 1M, BEAM 10M, LongMemEval recall.
Sources included in this catalog (3)
- Mnemetric Phase 11 evidence note — source recorded 2026-10-06
- Mnemetric Phase 11 evidence note — source recorded 2026-10-06
- Mnemetric Phase 11 evidence note — source recorded 2026-10-06
agentmemory
Not reported in cited sources: LongMemEval, LoCoMo, BEAM 1M, BEAM 10M, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (2)
- agentmemory README — source recorded 2026-10-06
- agentmemory README — source recorded 2026-10-06
NV-Embed-v2
Not reported in cited sources: LongMemEval, LoCoMo, BEAM 1M, BEAM 10M, LongMemEval recall.
Sources included in this catalog (1)
- HippoRAG 2 paper, arXiv 2502.14802, Table 3 (passage recall@5) — source recorded 2026-10-06
GritLM-7B
Not reported in cited sources: LongMemEval, LoCoMo, BEAM 1M, BEAM 10M, LongMemEval recall.
Sources included in this catalog (1)
- HippoRAG 2 paper, arXiv 2502.14802, Table 3 (passage recall@5) — source recorded 2026-10-06
HippoRAG
Not reported in cited sources: LongMemEval, BEAM 1M, BEAM 10M, LongMemEval recall.
Sources included in this catalog (2)
- HippoRAG 2 paper, arXiv 2502.14802, Table 3 (passage recall@5) — source recorded 2026-10-06
- Memora paper, arXiv 2602.03315 — source recorded 2026-10-30
GTE-Qwen2-7B-Instruct
Not reported in cited sources: LongMemEval, LoCoMo, BEAM 1M, BEAM 10M, LongMemEval recall.
Sources included in this catalog (1)
- HippoRAG 2 paper, arXiv 2502.14802, Table 3 (passage recall@5) — source recorded 2026-10-06
RAPTOR
Not reported in cited sources: LongMemEval, LoCoMo, BEAM 1M, BEAM 10M, LongMemEval recall.
Sources included in this catalog (1)
- HippoRAG 2 paper, arXiv 2502.14802, Table 3 (passage recall@5) — source recorded 2026-10-06
Contriever
Not reported in cited sources: LongMemEval, LoCoMo, BEAM 1M, BEAM 10M.
Sources included in this catalog (2)
- HippoRAG 2 paper, arXiv 2502.14802, Table 3 (passage recall@5) — source recorded 2026-10-06
- LongMemEval paper, arXiv 2410.10813, Table 9 (retriever comparison) — source recorded 2026-10-06
BM25
Not reported in cited sources: LongMemEval, LoCoMo, BEAM 1M, BEAM 10M.
Sources included in this catalog (2)
- HippoRAG 2 paper, arXiv 2502.14802, Table 3 (passage recall@5) — source recorded 2026-10-06
- LongMemEval paper, arXiv 2410.10813, Table 9 (retriever comparison) — source recorded 2026-10-06
GTR (T5-base)
Not reported in cited sources: LongMemEval, LoCoMo, BEAM 1M, BEAM 10M, LongMemEval recall.
Sources included in this catalog (1)
- HippoRAG 2 paper, arXiv 2502.14802, Table 3 (passage recall@5) — source recorded 2026-10-06
Stella V5 1.5B
Not reported in cited sources: LongMemEval, LoCoMo, BEAM 1M, BEAM 10M, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (1)
- LongMemEval paper, arXiv 2410.10813, Table 9 (retriever comparison) — source recorded 2026-10-06
OpenViking
Not reported in cited sources: BEAM 1M, LongMemEval recall, HotpotQA recall, 2Wiki recall, MuSiQue recall.
Sources included in this catalog (2)
- OpenViking README — source recorded 2026-10-06
- OmniMemEval reproduced result snapshot — source recorded 2026-10-30