ResearchResearch paperRetrieval, RAG & Search · Large Language Models1 source · Oct 20, 2026

Scan or Index? large Evidence Coverage, Answer Quality, and Cost in Long-Document RAG

Scanning every passage in a long document seems thorough, but does it preserve more useful evidence or produce better answers?

Key points

  • We compare 11 retrieval configurations spanning lexical and dense search, hybrid reranking, and full-document scanning with Jev, OpenAI Decisions, and Cloudflare Clef.
  • On books, Hybrid + Jev achieves the highest observed evidence coverage (94.1%), compared with 88.7% for Jev full scan and 81.3% for OpenAI dense retrieval.
  • Higher evidence coverage also does not consistently produce better answers: Hybrid + Decisions achieves the highest observed book Answer Accuracy among retrieval methods (0.892), despite recovering less reference evidence.
  • These results highlight evidence retention, answer quality, and reuse cost as complementary criteria for choosing a long-document retrieval strategy.

Sources (1)

  • [1]Scan or Index? large Evidence Coverage, Answer Quality, and Cost in Long-Document RAG
    arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 20, 10:11 PM
    Scanning every passage in a long document seems thorough, but does it preserve more useful evidence or produce better answers?
    We compare 11 retrieval configurations spanning lexical and dense search, hybrid reranking, and full-document scanning with Jev, OpenAI Decisions, and Cloudflare Clef.

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 20, 2026[AINews] DeepSeek DeepInfer: Open Source SOTA Inference running 155T toks/day/cluster making $22m/day at ~80% margin for a 81 day payback
  2. Oct 20, 2026RAG-NIMBF: A Non-Invasive, Modular Benchmarking Framework for Automated RAG Configuration Analysis
  3. Oct 20, 2026How To Use Decision Models for Evals
  4. Oct 20, 2026Do Diffusion LLMs Scale? Testing Mercury 3 + Decide
  5. Oct 19, 2026Introducing Clairic, a new System One class of extraction models
  6. Oct 19, 2026Advancing Coding in Low-Resource Programming Languages

Related