Scan or Index? large Evidence Coverage, Answer Quality, and Cost in Long-Document RAG
Scanning every passage in a long document seems thorough, but does it preserve more useful evidence or produce better answers?
ProofPaper ↗
Key points
- We compare 11 retrieval configurations spanning lexical and dense search, hybrid reranking, and full-document scanning with Jev, OpenAI Decisions, and Cloudflare Clef.
- On books, Hybrid + Jev achieves the highest observed evidence coverage (94.1%), compared with 88.7% for Jev full scan and 81.3% for OpenAI dense retrieval.
- Higher evidence coverage also does not consistently produce better answers: Hybrid + Decisions achieves the highest observed book Answer Accuracy among retrieval methods (0.892), despite recovering less reference evidence.
- These results highlight evidence retention, answer quality, and reuse cost as complementary criteria for choosing a long-document retrieval strategy.
Sources (1)
- [1]Scan or Index? large Evidence Coverage, Answer Quality, and Cost in Long-Document RAGarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 20, 10:11 PM
Scanning every passage in a long document seems thorough, but does it preserve more useful evidence or produce better answers?
We compare 11 retrieval configurations spanning lexical and dense search, hybrid reranking, and full-document scanning with Jev, OpenAI Decisions, and Cloudflare Clef.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 20, 2026[AINews] DeepSeek DeepInfer: Open Source SOTA Inference running 155T toks/day/cluster making $22m/day at ~80% margin for a 81 day payback
- Oct 20, 2026RAG-NIMBF: A Non-Invasive, Modular Benchmarking Framework for Automated RAG Configuration Analysis
- Oct 20, 2026How To Use Decision Models for Evals
- Oct 20, 2026Do Diffusion LLMs Scale? Testing Mercury 3 + Decide
- Oct 19, 2026Introducing Clairic, a new System One class of extraction models
- Oct 19, 2026Advancing Coding in Low-Resource Programming Languages