nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB · Hugging Face
NVIDIA Nemotron 3.5 Bolt 74B-A9B 24GB is a vision-language model (VLM) designed to run everyday agentic tasks locally, using a native 2-bit quantization to fit in 24GB of memory and run alongside other applications.
Proof1 community thread
Key points
- This model is ready for commercial or non‐commercial use.
- Deployment 24GB packed model; vLLM on NVIDIA Ampere (A100), Hopper (H100-80GB), or Blackwell
- Speculative Decoding LiLiCorr drafter via DFlash; 7 speculative tokens in the companion Bolt vLLM recipes
- NVIDIA NemotronTM is a family of open models with open weights, training data, and recipes, delivering leading efficiency and accuracy for building specialized AI agents.NVIDIA Nemotron 3.5 Bolt 74B-A9B 24GB is a vision-language model (VLM) designed to run everyday agentic tasks locally, using a native 2-bit quantization to fit in 24GB of memory and run alongside other applications.
Sources (1)
- [1]nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB · Hugging Facer/LocalLLaMA (top, daily) · Oct 15, 03:04 PM
NVIDIA Nemotron 3.5 Bolt 74B-A9B 24GB is a vision-language model (VLM) designed to run everyday agentic tasks locally, using a native 2-bit quantization to fit in 24GB of memory and run alongside other applications.
This model is ready for commercial or non‐commercial use.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 15, 2026NVIDIA Nemotron 3.5 Super VL Powers Specialized Agents with Multimodal Reasoning
- Oct 15, 2026StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context
- Oct 15, 2026Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio
- Oct 15, 2026Welcome FLUX.3 Image Klein in Diffusers
- Oct 14, 2026NVIDIA/TensorRT-LLM v1.4.0rc0
- Oct 14, 2026mistralai/Timestral-209M
