AnalysisOpinion / analysisEfficiency & Inference · Hardware & Compute1 source · Oct 15, 2026

**DeepSeek-V4-Flash-0731 on 4x Radeon AI PRO R9700 with affinity: the "refused" 4-card config works, ~79 tok/s on real cards**

Setup: Threadripper PRO 9955WX, 128 GB RAM, four R9700s all on CPU lanes with P2P between every pair.

Proof1 community thread

Key points

  • Nobody had tried it on four real R9700s.
  • 4 cards: 79 tok/s greedy, 63 at temp 1.0, about 90 on a chat answer with thinking on.
  • The engine's own cross-rank check (it compares the cards against each other every few samples) passed every time.
  • So the bug the author hit lives in the 4-on-2 simulation, not in 4-rank execution. u/neuromacmd already suspected this.

Sources (1)

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 15, 2026open source framework that makes your AI agents generate UI elements
  2. Oct 15, 2026Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint
  3. Oct 15, 2026What a £300, 35W Snapdragon mini PC can actually do 👀: 35B coder at ~30 tok/s, and an 80B model that doesnt even fit in RAM running at 17 tok/s
  4. Oct 15, 2026REKI: Registering Knowledge in VLAs
  5. Oct 15, 2026Welcome FLUX.3 Image Klein in Diffusers
  6. Oct 14, 2026Introducing Timestral

Related