DeepSeek V4.1 Flash 1017 on 2x DGX Spark: 57 tok/s text, 92 tok/s code with TensorFold (2.1-2.3x the vLLM kit)
TL;DR: DeepSeek-V4.1-Flash-1017 (EXL3 2.9bpw, 1M context) on 2x DGX Spark, TP=2 over the CX7 cable.
Proof1 community thread
Key points
- TensorFold is 2.1-2.3x faster than the vLLM kit on the same pair, same weights, same prompts, same day.
- Cold prefill (random-word prompts, no cache hit, bertholomus's kitbench client), measured tonight:
- So roughly 2.2-2.4x vLLM on prefill too.
- It lands in the repo in the next update. bertholomus's engine publishes ~2,400 at 32K, and I'm still closing that gap.
Sources (1)
- [1]DeepSeek V4.1 Flash 1017 on 2x DGX Spark: 57 tok/s text, 92 tok/s code with TensorFold (2.1-2.3x the vLLM kit)r/LocalLLaMA (top, daily) · Oct 18, 01:00 AM
**TL;DR:** DeepSeek-V4.1-Flash-1017 (EXL3 2.9bpw, 1M context) on 2x DGX Spark, TP=2 over the CX7 cable.
TensorFold is 2.1-2.3x faster than the vLLM kit on the same pair, same weights, same prompts, same day.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 17, 2026Fish Audio Drama 3 says it needs a 48 GB NVIDIA card. My 16 GB Radeon disagrees.
- Oct 17, 2026deepseek-ai/DeepSeek-V4.1-Flash-1017
- Oct 16, 2026[Research] 2,788 tokens/s on a single RTX 5090 with a diffusion LLM — Introducing ORL (fully open source)
- Oct 16, 2026Welcome Beam: a 501B open model you can own, customize, and scale
- Oct 15, 2026Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint
- Oct 15, 2026NVIDIA Nemotron 3.5 Super VL Powers Specialized Agents with Multimodal Reasoning