ResearchResearch paperRetrieval, RAG & Search · Evaluation & Benchmarks2 sources · Oct 21, 2026

Retrieval Augmented Generation Compositionality

Retrieval Augmented Generation (RAG) grounds large language models in external knowledge.

Key points

  • Modern pipelines combine embedding, chunking, retrieval, reranking, query augmentation, context compression, and agentic verification, yet these techniques are typically evaluated one at a time.
  • It remains unclear whether their isolated gains survive composition, whether retrieval quality and answer faithfulness favor the same design choices, and whether conclusions from small corpora hold at large scale.
  • We pre-declare three hypotheses and introduce LASAGNA, an open-source framework for controlled RAG evaluation.
  • First, individually strong techniques from different phases of a RAG pipeline do not necessarily compose: three retrieval techniques predict a +47% combined improvement but deliver only +17% when used together.

Sources (2)

  • [1]Retrieval Augmented Generation Compositionality
    Hugging Face Daily Papers · Oct 21, 12:00 AM
    Retrieval Augmented Generation (RAG) grounds large language models in external knowledge.
    Modern pipelines combine embedding, chunking, retrieval, reranking, query augmentation, context compression, and agentic verification, yet these techniques are typically evaluated one at a time.
  • [2]Retrieval Augmented Generation Compositionality
    arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 21, 01:30 PM · same content

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 20, 2026Beyond the KV cache: Training and serving i14’s Laplace 3B linear attention model on AWS Trainium2 with native PyTorch
  2. Oct 20, 2026Do Diffusion LLMs Scale? Testing Mercury 3 + Decide
  3. Oct 19, 2026Push-based KV transfer to improve TTFT and TPOT for disaggregated inference in vLLM
  4. Oct 16, 2026MAS-Bai: Linguistically Informed Adaptive Multi-Agent Translation for Bowen-Script Bai
  5. Oct 15, 2026Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint
  6. Oct 15, 2026Private Retrieval Augmented Generation via Random Projection

Related