ggml-org/llama.cpp v0.7.0
The server gets a refactored chat session API (commonchatsession, part-based formatted output), much better slot and prompt-cache restore behavior, decision-model support for the new architectures and a new default port (9931), the web UI gains a full models manager, and ggml is updated to v0.27.0.
ProofCode ↗
Sources (1)
- [1]ggml-org/llama.cpp v0.7.0GitHub: ggml-org/llama.cpp · Oct 15, 05:13 PM
The server gets a refactored chat session API (`common_chat_session`, part-based formatted output), much better slot and prompt-cache restore behavior, decision-model support for the new architectures and a new default port (9931), the web UI gains a full models manager, and ggml is updated to v0.27.0.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 15, 2026nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB · Hugging Face
- Oct 15, 2026NVIDIA Nemotron 3.5 Super VL Powers Specialized Agents with Multimodal Reasoning
- Oct 15, 2026StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context
- Oct 15, 2026Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio
- Oct 14, 2026NVIDIA/TensorRT-LLM v1.4.0rc0
- Oct 14, 2026Introducing Timestral
