ResearchResearch paperRetrieval, RAG & Search · Large Language Models1 source · Oct 21, 2026

pplx-embed-v2-late Technical Report

In this report, we introduce pplx-embed-v2-late, a pair of 0.6B and 9B multilingual and multimodal late-interaction models.

Key points

  • Both models achieve state-of-the-art results within their respective size classes across a range of text, image, and visual document retrieval benchmarks.
  • On visual document retrieval tasks, pplx-embed-v2-late-0.6b is competitive with models several times larger than itself.
  • The models are trained via representation distillation from an 18B teacher.
  • Consequently, they share an embedding space that supports asymmetric deployment: documents can be indexed with the 9B model and queried with the low-latency 0.6B model.

Sources (1)

  • [1]pplx-embed-v2-late Technical Report
    arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 21, 10:10 AM
    In this report, we introduce pplx-embed-v2-late, a pair of 0.6B and 9B multilingual and multimodal late-interaction models.
    Both models achieve state-of-the-art results within their respective size classes across a range of text, image, and visual document retrieval benchmarks.

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 20, 2026CSD: Common-Support Distillation for Cross-Tokenizer Knowledge Transfer
  2. Oct 20, 2026XHToken/Spark-X2.6-4B · Hugging Face
  3. Oct 20, 2026Gradium Open-Sources Phonon, a 31M-Parameter On-Device TTS Model Under Apache 2.0
  4. Oct 20, 2026Exa 3.0 Search API Tops Perplexity, Brave and Parallel on 8 Benchmarks
  5. Oct 20, 2026Ask to Distill: Learning to Synthesize Data for On-Policy Distillation
  6. Oct 20, 2026Training the Whole Agent, Not Just the Model

Related