ResearchResearch paperMultimodal Models · Reasoning & Planning · Large Language Models2 sources · Oct 16, 2026

Xiaomi-Lens-0 Technical Report

To close this gap, we present Xiaomi-Lens-0, a 4B MLLM built on Qwen3.5 that predicts masks from its own visual representations.

Key points

  • Multimodal large language models (MLLMs) answer questions about whole images well, yet they still struggle with fine-grained region understanding.
  • Specifically, a lightweight decoder combines vision-encoder patch features with visual latents, the language model's mask-token states, so mask supervision reaches the shared backbone without an additional segmentation encoder.
  • Because each latent decodes to a mask, the model can interleave reasoning with region-specific latents and thus think with visual latents, while grounded reasoning traces supervise the regions it visits during chain-of-thought.
  • As a result, across all eight RefCOCO, RefCOCO+, and RefCOCOg splits, Xiaomi-Lens-0 gains 5.6 points on average over Qwen3.5 in referring comprehension and achieves the highest segmentation cIoU among compared models.

Sources (2)

  • [1]Xiaomi-Lens-0 Technical Report
    arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 16, 10:50 AM
    To close this gap, we present Xiaomi-Lens-0, a 4B MLLM built on Qwen3.5 that predicts masks from its own visual representations.
    Multimodal large language models (MLLMs) answer questions about whole images well, yet they still struggle with fine-grained region understanding.
  • [2]Xiaomi-Lens-0 Technical Report
    Hugging Face Daily Papers · Oct 16, 12:00 AM · same content

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 15, 2026A Plausible Explanation Is Enough to Mislead Multimodal Judges
  2. Oct 15, 2026QUASAR 4-bit QAT checkpoints for Qwen3.5, Gemma 4 and Muse Glimmer: closer to BF16 than Google’s and NVIDIA’s 4-bit releases
  3. Oct 15, 2026Literal Lock-In: How Test Language Shifts Literal Attraction in Typed Decision Models on Bengali Idioms
  4. Oct 15, 2026huggingface/transformers v5.20.0: Release v5.20.0
  5. Oct 15, 2026SUPRA-TEX: 3D Generation with Super-Aligned Texture
  6. Oct 15, 2026OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using Agents

Related