Open source LLM appreciation post
I just downloaded Raon-1-mini 30B A4B as well as Flint 40B A2.5B and it just blows my mind that we have so many options now from so many countries.
Proof1 community thread
Key points
- It feels like the countries are all working together and trying to contribute useful software and it’s just amazing.
- I can fucking TALK to my computer and have it answer like fucking Star Trek.
- Every day I use this tech I’m just more and more blown away.
Sources (1)
- [1]Open source LLM appreciation postr/LocalLLaMA (top, daily) · Oct 22, 01:45 AM
I just downloaded Raon-1-mini 30B A4B as well as Flint 40B A2.5B and it just blows my mind that we have so many options now from so many countries.
It feels like the countries are all working together and trying to contribute useful software and it’s just amazing.
Extractive summary: sentences quoted from the sources.
Hype check
Independently evaluated2 independent looks since
- Evaluation · Oct 22, 2026How to Test AI Agents When No Benchmark Exists — Nathanael Weill, Air Canada
- Evaluation · Oct 22, 2026Cohere Releases Rerank 5 With Passage-Level Context Focus and Calibrated Scores
- Follow-up · Oct 22, 2026GSQ Quantization Explained with Qwen3.8 27B
- Follow-up · Oct 22, 20268 and 4-step MiniMax-H3 PTD Ref2VA Acceleration LoRAs
- Follow-up · Oct 22, 2026I have an answer! Qwen Flash Next IQ2 IS better than Q8 of 27B (for me).
- Follow-up · Oct 22, 2026What's your favorite medium to large (~50-150b params) MOE model? Aside from Qwen flash next.
Before this
- Oct 22, 20262-bit copy in VRAM + exact residual in system RAM as the verifier: speculative decoding for models that don't fit your GPU
- Oct 21, 2026Flat-RLVR: Sharpness-Aware Reinforcement Learning with Verifiable Rewards for Reasoning Capacity in LLMs
- Oct 20, 2026Gradium Open-Sources Phonon, a 31M-Parameter On-Device TTS Model Under Apache 2.0
- Oct 20, 2026Voxtral 3
- Oct 20, 2026[AINews] DeepSeek DeepInfer: Open Source SOTA Inference running 155T toks/day/cluster making $22m/day at ~80% margin for a 81 day payback
- Oct 20, 2026MiniMax H3 - Really is the best open-source video model.
