ProductsAPI / SDK changeMLOps, Tooling & Infrastructure1 source · Oct 19, 2026

llama server's default port changed from 8080 to 9931

Starting from v0.7.0, the default port for llama server is now 9931 (ggml).

Proof1 community thread

Key points

  • Those who did not explicitly set the port, expect breaking change upon upgrading.
  • Those who use harnesses that have hardcoded 8080 port, good luck.

Sources (1)

Extractive summary: sentences quoted from the sources.

Hype check

Questioned1 reported issue since

  1. Issue · Oct 19, 2026Fem Malfoy's Remembrall Incident
  2. Evaluation · Oct 19, 2026Krea 2 Turbo @ 4 steps (w/ my 4-step LoRA) vs MOSS SFT at 4 steps (ww AK's 4-step LoRA) - same prompt set you've seen me publish in the past (headline: MOSS is really good! and great job by AK on his LoRA)
  3. Evaluation · Oct 19, 20266M param character renderer: one reference image in, a minute of video out, tested against Blender truth
  4. Evaluation · Oct 19, 2026AI generates research ideas faster than I can test them. Anyone else? [R]
  5. Follow-up · Oct 19, 2026Qwen3.8-27B and Flash-Next on consumer hardware: engine numbers I could verify, and what they cost with 2026 RAM prices
  6. Follow-up · Oct 19, 2026DeepSeek V4.1 Flash at 2.61 bpw + Engram: 26 t/s on dual RTX 3090s with dsx

Before this

  1. Oct 19, 2026Don't sleep on Nemotron 3.5 Super VL
  2. Oct 18, 202672 hours, four big open weights drops. The only one that fits in 24GB came from NVIDIA, of all companies.
  3. Oct 18, 2026llama-doctor: CLI tool and live dashboard that reads your llama.cpp metrics and tells you what's wrong
  4. Oct 17, 2026Nemotron 3.5 Bolt, Muse Spark Open, and a Fast LFM2.5 24B
  5. Oct 15, 2026Ternary Bonsai 2 Family: 2B, 4B, & 9B based on Qwen 3.5
  6. Oct 15, 2026QUASAR 4-bit QAT checkpoints for Qwen3.5, Gemma 4 and Muse Glimmer: closer to BF16 than Google’s and NVIDIA’s 4-bit releases

Related