AnalysisTutorial / explainerEvaluation & Benchmarks · Efficiency & Inference1 source · Oct 22, 2026

Llama.cpp PR: How to beat strata decode performance with a R9700

llama.cpp
Proof1 community thread
Read at r/LocalLLaMA (top, daily) ↗← Today

Sources (1)

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 22, 2026Hugging Face’s New AI Biology Model Lets You Chat With DNA
  2. Oct 22, 2026Tried LFM2.5-24-A2B. It's crap. Yes. I double confirm it. I wouldn't trust it peeling a peanut correctly
  3. Oct 22, 20262-bit copy in VRAM + exact residual in system RAM as the verifier: speculative decoding for models that don't fit your GPU
  4. Oct 21, 2026Recursive shows first result of its AI-driven research process with Flint
  5. Oct 21, 2026llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp
  6. Oct 21, 202635B MoE running at 20.5 tok/s on an iPhone, without skipping experts

Related

r/LocalLLaMA10d ago

llama.cpp optimizations for specific hardware and models

r/LocalLLaMA5d ago

CUDA: faster MMVQ for low-bit types by am17an · Pull Request #30517 · ggml-org/llama.cpp

r/LocalLLaMA4d ago

Is there a Strata for lfm 24b a2b

r/LocalLLaMA3d ago

6M param character renderer: one reference image in, a minute of video out, tested against Blender truth