MossImage quants & SFT fix
I recommend the INT8 as a start. nVidia RTX20x+ & RDNA2 (RX6000)+ are good.
Proof1 community thread
Key points
- ARM needs fairly recent GPUs to have the right OpCodes; Raspberry Pi 5 & M5/A17 Pro+ for NE support.
- If those seem too slow, or if really VRAM constrained, then try a GGUF quant.
- Also there is a SFT banding fix LoRA.
- edit: early LoRAs & LoRA training in comment.
Sources (1)
- [1]MossImage quants & SFT fixr/StableDiffusion (top, day) · Oct 17, 11:17 AM
I recommend the INT8 as a start. nVidia RTX20x+ & RDNA2 (RX6000)+ are good.
ARM needs fairly recent GPUs to have the right OpCodes; Raspberry Pi 5 & M5/A17 Pro+ for NE support.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 16, 2026nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-MXFP8
- Oct 15, 2026Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint
- Oct 15, 2026QUASAR 4-bit QAT checkpoints for Qwen3.5, Gemma 4 and Muse Glimmer: closer to BF16 than Google’s and NVIDIA’s 4-bit releases
- Oct 15, 2026unslothai/unsloth v0.1.908-beta: NVIDIA Nemotron 3.5 + Meta Muse Spark Open
- Oct 15, 2026NVIDIA Nemotron 3.5 Super VL Powers Specialized Agents with Multimodal Reasoning
- Oct 15, 2026Welcome FLUX.3 Image Klein in Diffusers
