Calling all GPUs: help us benchmark SonicBoom v0.0.3 — a compiler-first AI runtime that beats llama.cpp on decode
SonicBoom is our open-source (GPLv3) inference runtime: a compiler-first alternative to the usual Python stack.
Proof1 community thread
Key points
- We are HardenedLinux, an old-school free software community.
- What v0.0.3 does on a desktop RTX 3050 8 GB (same session, same GGUF, vs llama.cpp -ngl 99):
- Where we are honest about gaps: Qwen decode at depth 512 is 0.98×, and we have only one GPU.
- The invitation: every release gets one benchmark issue.
Sources (1)
- [1]Calling all GPUs: help us benchmark SonicBoom v0.0.3 — a compiler-first AI runtime that beats llama.cpp on decoder/LocalLLaMA (top, daily) · Oct 19, 03:40 AM
SonicBoom is our open-source (GPLv3) inference runtime: a compiler-first alternative to the usual Python stack.
We are HardenedLinux, an old-school free software community.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 18, 2026Google Open-Sources Harness2, a Recursive Agent Harnessing Framework
- Oct 17, 2026Nemotron 3.5 Bolt, Muse Spark Open, and a Fast LFM2.5 24B
- Oct 16, 2026nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-MXFP8
- Oct 15, 2026Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint
- Oct 15, 2026QUASAR 4-bit QAT checkpoints for Qwen3.5, Gemma 4 and Muse Glimmer: closer to BF16 than Google’s and NVIDIA’s 4-bit releases
- Oct 15, 2026NVIDIA Nemotron 3.5 Super VL Powers Specialized Agents with Multimodal Reasoning
