AnalysisTutorial / explainerHardware & Compute · Efficiency & Inference1 source · Oct 11, 2026

Building a 4x R9700 setup for a 10 person startup

Just wanted to share a build I am doing for a client.

QwenAMD
Proof1 community thread
Read at r/LocalLLaMA (top, daily) ↗← Today

Key points

  • 4x AMD Radeon R9700 AI Pro 32gb(128gb total VRAM)
  • 1600W PSU(GPUs are undervolted and under 210w each)
  • Engine: using a fork of Radiance to serve Qwen 3.8 Next flash/27b and DSV4 Flash
  • 900 t/s - 80t/s aggregate decode(range: 4k - 128k context each)

Sources (1)

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 10, 2026Improve token per second without touching quant
  2. Oct 10, 2026vllm-sr/d3
  3. Oct 9, 2026nvidia/Qwen-Image-NVFP4
  4. Oct 9, 2026Qwen/Qwen-Image-2.1-Turbo
  5. Oct 9, 2026Introducing Clef-omni with full multimodality, plus a faster Clef and a cheaper Clef-flash
  6. Oct 8, 2026nvidia/Qwen3.8-Flash-Next-FP4-Local

Related

r/LocalLLaMA5d ago

176 t/s decode and 6,450 t/s prefill with Q4 Qwen-3.8 Flash-Next on 2xR9700 + 64GB DDR5 using Deadcode's Radiance engine

r/LocalLLaMA5d ago

4x R9700 builds with $127 used EPYCs: $10.7k all-in per machine. I built three (384GB VRAM)

r/LocalLLaMA1d ago

Qwen 3.8 Flash Next optimized for two CMP 170hx GPUs

r/LocalLLaMA1d ago

You don’t need that expensive of a build for local llms.