AnalysisOpinion / analysisHardware & Compute · Efficiency & Inference1 source · Oct 20, 2026

How do I make MOSS-Image-SFT (INT8) faster like 8 steps?

Hey everybody, my card is the RX 6600.

Proof1 community thread

Key points

  • My pc was made for gaming, and its a capable pc, but when it comes to ai, oh brother that is the weakness right there.
  • I already have ROCm and ComfyUI, it's just that... the speeds on the best model right now are rancid.
  • 1MP = Dear lord, nearly 11 minutes.
  • Is there ANYTHING I can do to bring down the generation time to like, 10-30 or 60ish seconds?

Sources (1)

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 20, 2026Voxtral 3
  2. Oct 20, 2026[AINews] DeepSeek DeepInfer: Open Source SOTA Inference running 155T toks/day/cluster making $22m/day at ~80% margin for a 81 day payback
  3. Oct 20, 2026MPS in PyTorch 2.15
  4. Oct 19, 2026MiniMax M3.1 Flash shows China's AI price race has no floor in sight
  5. Oct 19, 2026Basic Workflow Simple Prompt Testing: Krea2 vs MOSS vs Qwen2.1 vs Flux3
  6. Oct 19, 2026Calling all GPUs: help us benchmark SonicBoom v0.0.3 — a compiler-first AI runtime that beats llama.cpp on decode

Related