AnalysisOpinion / analysisLarge Language Models · Efficiency & Inference · Hardware & Compute1 source · Oct 17, 2026

nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16 · Hugging Face

Looped (latent-recurrent) normalized-GPT with interleaved sliding-window attention (SWA) and full-attention layers

Proof1 community thread

Key points

  • General-purpose reasoning on a small footprint
  • NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16 is a looped (latent-recurrent) large language model (LLM) trained by NVIDIA.
  • By repeatedly applying a shared block of layers, Dory1.0-4B can spend more compute per token allowing it to scale intelligence.
  • This model is ready for commercial or non-commercial use.

Sources (1)

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 17, 2026deepseek-ai/DeepSeek-V4.1-Flash-1017
  2. Oct 16, 2026nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-MXFP8
  3. Oct 15, 2026Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint
  4. Oct 15, 2026QUASAR 4-bit QAT checkpoints for Qwen3.5, Gemma 4 and Muse Glimmer: closer to BF16 than Google’s and NVIDIA’s 4-bit releases
  5. Oct 15, 2026unslothai/unsloth v0.1.908-beta: NVIDIA Nemotron 3.5 + Meta Muse Spark Open
  6. Oct 15, 2026NVIDIA Nemotron 3.5 Super VL Powers Specialized Agents with Multimodal Reasoning

Related