New quant types suggested: IQ2_K, IQ3_K, IQ4_K, IQ5_K and IQ6_K
File sizes are the same as Q-quants.
Proof1 community thread
Key points
- Lots of numbers presented, but for a single model only.
- Creating IQ quants is somewhat slow.
- Appologies to Mr. Addario if I mangled anything.
Sources (1)
- [1]New quant types suggested: IQ2_K, IQ3_K, IQ4_K, IQ5_K and IQ6_Kr/LocalLLaMA (top, daily) · Oct 18, 10:06 AM
- File sizes are the same as Q-quants.
Lots of numbers presented, but for a single model only.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 18, 2026GPT-2 KV cache from scratch: correctness, latency, and memory measurements [P]
- Oct 17, 2026deepseek-ai/DeepSeek-V4.1-Flash-1017
- Oct 16, 2026Comfy-Org/MOSS-Image
- Oct 15, 2026Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint
- Oct 15, 2026QUASAR 4-bit QAT checkpoints for Qwen3.5, Gemma 4 and Muse Glimmer: closer to BF16 than Google’s and NVIDIA’s 4-bit releases
- Oct 15, 2026huggingface/transformers v5.20.0: Release v5.20.0
