Mapping the Post-Transformer Architecture Landscape in 2026 [D]
Went down the rabbit hole to map the different Post-Transformer architectures.
Proof1 community thread
Key points
- Various directions include Dragon Hatchling (BDH), Mamba, RWKV, xLSTM, Titans, and a bunch of hybrid models coming from different AI Labs.
- Mamba-2 / Mamba-3 - Gu, Dao et al. Selective SSM; Mamba-3 adds complex-valued state + MIMO
- BDH (Dragon Hatchling) - Pathway Graph of neurons, attention emerges from local interactions.
- Titans - Google Research Neural long-term memory module updated by "surprise" at test time
Sources (1)
- [1]Mapping the Post-Transformer Architecture Landscape in 2026 [D]r/MachineLearning (top, daily) · Oct 14, 03:22 PM
Went down the rabbit hole to map the different Post-Transformer architectures.
Various directions include Dragon Hatchling (BDH), Mamba, RWKV, xLSTM, Titans, and a bunch of hybrid models coming from different AI Labs.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 14, 2026GPT-Image-style photo editing on your own GPU (12 GB+): I built a zero-setup app for Qwen-Image 2.1 on stable-diffusion.cpp
- Oct 14, 2026mistralai/Timestral-209M
- Oct 13, 2026Run fast, private agents on-device with LFM2.5-24B-A2B
- Oct 13, 2026Gemini 4 Argon: Built to solve your hardest problems
- Oct 13, 2026An 80B MoE (Qwen3-Next, 48 GB GGUF) answering in a Chrome tab: llama.cpp's WebGPU backend, experts paged in from disk
- Oct 13, 2026Horsey challenge | Strata Fork | Qwen 3.8 FN NVFP4
