AnalysisOpinion / analysisHardware & Compute · Efficiency & Inference1 source · Oct 15, 2026

FP4 QAD quant of Qwen3.8-Flash-Next from Nvidia

Would be cool to see some of the Qwen3.8-FN specific engines support this.

Proof1 community thread

Key points

  • Size is pretty small at 102GB.

Sources (1)

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 15, 2026QUASAR 4-bit QAT checkpoints for Qwen3.5, Gemma 4 and Muse Glimmer: closer to BF16 than Google’s and NVIDIA’s 4-bit releases
  2. Oct 15, 2026nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB · Hugging Face
  3. Oct 15, 2026NVIDIA Nemotron 3.5 Super VL Powers Specialized Agents with Multimodal Reasoning
  4. Oct 14, 2026I built an open-source dubber that keeps each actor’s own voice, fully local (OmniVoice + Whisper, 6 GB+ NVIDIA)
  5. Oct 14, 2026qwen3.8-flash-next-iq3_s vs -27B-GGUF:UD-Q4_K_XL
  6. Oct 14, 2026GPT-Image-style photo editing on your own GPU (12 GB+): I built a zero-setup app for Qwen-Image 2.1 on stable-diffusion.cpp

Related