llama-doctor: CLI tool and live dashboard that reads your llama.cpp metrics and tells you what's wrong
Points at a running llama.cpp or Unsloth Studio server, pulls /metrics, /props and /slots, and gives you severity-graded findings: prefill vs decode, queue pressure, prefix cache reuse, memory headroom.
Proof1 community thread
Key points
- Exit codes map to severity, so cron can gate on it.
- Open to PRs, especially from anyone with a server that makes it crash.
Sources (1)
- [1]llama-doctor: CLI tool and live dashboard that reads your llama.cpp metrics and tells you what's wrongr/LocalLLaMA (top, daily) · Oct 18, 06:38 PM
Points at a running llama.cpp or Unsloth Studio server, pulls /metrics, /props and /slots, and gives you severity-graded findings: prefill vs decode, queue pressure, prefix cache reuse, memory headroom.
Exit codes map to severity, so cron can gate on it.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 18, 2026Google Open-Sources Harness2, a Recursive Agent Harnessing Framework
- Oct 18, 2026You don’t need that expensive of a build for local llms.
- Oct 17, 2026Qwen Flash Next on Mac Mini is runnable without maxing out your memory - results of different memory usage for ssd streaming
- Oct 16, 2026[P] my rust framework trains nanoGPT with the exact same bits as pytorch. worth continuing? [P]
- Oct 16, 2026Welcome Beam: a 501B open model you can own, customize, and scale
- Oct 15, 2026QUASAR 4-bit QAT checkpoints for Qwen3.5, Gemma 4 and Muse Glimmer: closer to BF16 than Google’s and NVIDIA’s 4-bit releases
