ResearchResearch paperEfficiency & Inference · Large Language Models · Reasoning & Planning1 source · Oct 17, 2026

CADS: Measuring the Incremental Contribution of LLM Proposers in Sequential Biological Screens

We present Certified Agentic Discovery Screens (CADS), an error-controlled measurement framework that quantifies a proposer's incremental value against an identical LLM-free loop.

Key points

  • Large language models are increasingly used to guide sequential biological screens, yet standard evaluations rely on raw hit counts that conflate a proposer's value with the discovery capacity of the underlying algorithmic harness.
  • Adaptive sampling and corrupted experimental readouts also leave standard feedback comparisons without a false-discovery guarantee.
  • By integrating capped likelihood-ratio bounds, e-processes, and complete-family e-BH, CADS controls the terminal false discovery rate under the stated null and corruption conditions despite arbitrary dependence, adaptive sampling, and optional stopping.
  • In DepMap-backed simulations, CADS exposes two evaluation artifacts: the LLM-free harness alone clears the feedback gate, and raw origin counts overstate LLM contributions because LLM picks displace fallback discoveries.

Sources (1)

  • [1]CADS: Measuring the Incremental Contribution of LLM Proposers in Sequential Biological Screens
    arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 17, 10:02 AM
    We present Certified Agentic Discovery Screens (CADS), an error-controlled measurement framework that quantifies a proposer's incremental value against an identical LLM-free loop.
    Large language models are increasingly used to guide sequential biological screens, yet standard evaluations rely on raw hit counts that conflate a proposer's value with the discovery capacity of the underlying algorithmic harness.

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 16, 2026Characterising and Analysing Retrieval-Augmented Generation Techniques
  2. Oct 16, 2026Before Retrieval Begins: Safety and Tool-Use Decisions in LLM Agents
  3. Oct 16, 2026Language Models Learn to Improve Language Models
  4. Oct 15, 2026NVIDIA Nemotron 3.5 Super VL Powers Specialized Agents with Multimodal Reasoning
  5. Oct 15, 2026Decomposing Brain-LLM Alignment with Interpretable Semantic Representations
  6. Oct 15, 2026Two Sample Sizes in Test-Time LLM Ensembling: Buffered ERM and Minimax Theory

Related