Analysis

NVIDIA Technical Blog5h ago
Accelerating Mamba-2 with High-Performance Forward Pass Kernels in NVIDIA CUDA Tile

AWS Machine Learning Blog6h ago
Improve TTFT for multi-turn agentic workloads with bi-directional KV transfer in vLLM
▶ Videor/MachineLearning4h ago
Open GPU kernel engineering series: naive GEMM to FlashAttention, H100 and Blackwell (44 sessions, code public) [P]

r/LocalLLaMA6h ago
We built our own inference engine so a 32B model could keep 262K context inside a 16 GB GPU budget. Here's an uncut run.
r/StableDiffusion8h ago
Krea 2 Turbo @ 4 steps (w/ my 4-step LoRA) vs MOSS SFT at 4 steps (ww AK's 4-step LoRA) - same prompt set you've seen me publish in the past (headline: MOSS is really good! and great job by AK on his LoRA)
▶ VideoDon't Worry About the Vase8h ago
I Can See Everything

The Verge7h ago
JB Pritzker thinks AI could help us live to 100 — or threaten us like nukes
r/MachineLearning5h ago
Maxwell: a new model that speeds up AI models like Whisper and LTX-2 by rewriting their binaries [D]
r/LocalLLaMA11h ago
Qwen3.8-27B and Flash-Next on consumer hardware: engine numbers I could verify, and what they cost with 2026 RAM prices
Newr/LocalLLaMA2h ago
Has anyone else here found a place for DiffusionGemma in their local work?

r/LocalLLaMA9h ago
A bare IPython harness ties production coding agents with Qwen3.5-9B on TB-Lite, and tool-output normalization fixed most of the run-to-run variance

r/LocalLLaMA15h ago
Kapitsa: open-source Apple Silicon optimized Metal engine built for Qwen and Nemotron. See benchmarks of Qwen 27B, Nemotron + 8 other models on an M1 Pro (16GB), M4 Pro (48GB) and M5 Max (128GB)
r/LocalLLaMA10h ago
DeepSeek V4.1 Flash at 2.61 bpw + Engram: 26 t/s on dual RTX 3090s with dsx

r/LocalLLaMA13h ago
incoai/Qwen3.8-Flash-Next-DFlash2
r/LocalLLaMA18h ago
Calling all GPUs: help us benchmark SonicBoom v0.0.3 — a compiler-first AI runtime that beats llama.cpp on decode
r/StableDiffusion14h ago
Struggling with Moss
r/StableDiffusion20h ago
MOSS Character LoRas
r/LocalLLaMA21h ago
Qwen 3.8 Flash Next optimized for two CMP 170hx GPUs
r/StableDiffusion22h ago
faster Moss gens for iterating (30s→10s)
r/LocalLLaMA18h ago