Analysis

Interconnects2d ago
Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio

NVIDIA Technical Blog6h ago
Accelerating Mamba-2 with High-Performance Forward Pass Kernels in NVIDIA CUDA Tile

The Decoder12h ago
The neocloud shakeout is coming, and Nvidia has the most to lose
r/LocalLLaMA12h ago
Qwen3.8-27B and Flash-Next on consumer hardware: engine numbers I could verify, and what they cost with 2026 RAM prices

Show HN2d ago
Show HN: Llmspeed – feel how fast a local LLM runs before you buy the hardware

The Verge3d ago
A week with RTX Spark: everything we’ve learned using Nvidia’s new laptops
▶ Videor/MachineLearning5h ago
Open GPU kernel engineering series: naive GEMM to FlashAttention, H100 and Blackwell (44 sessions, code public) [P]

SemiAnalysis17h ago
Datacenters 2027: The Year of Acceleration, +50GW in a Single Year

r/StableDiffusion1d ago
UPDATE ME ON MINIMAX

AWS Machine Learning Blog7d ago
Deploy decision models with llama.cpp on Amazon SageMaker AI
ChinAI7d ago
ChinAI #377: American Data Center Hegemony - the Center-Satellite Structure
Lobsters7d ago
Linus Torvalds Working On A Hefty Linux Kernel Improvement With Claude Code
Hacker News3d ago
Show HN: Gemini 4 Argon plays StarCraft

Two Minute Papers8d ago
Why DeepSeek Wants AI To Forget

WIRED7d ago
Elon Musk Bragged About His Grok Lego Star Wars Haul. Then X Users Punked Him

TechCrunch6d ago
Cerebras CEO says we’re nearing a future where everyone has a personal AI assistant at home

Epoch AI11d ago
The Epoch Brief - October 8, 2026
SiliconANGLE7d ago
Dell and Intel weigh the costs of enterprise AI scalability

AI Engineer8d ago
Taming the AI Hardware Cambrian Explosion — Abdul Dakkak, Modular

Ars Technica17d ago
US arrests tech CEO accused of smuggling $300M in Nvidia chips into China
Google DeepMind Blog26d ago
Advancing Private AI Compute with secure, server-side memory

r/LocalLLaMA19h ago
Don't sleep on Nemotron 3.5 Super VL

r/LocalLLaMA2d ago
Fish Audio Drama 3 says it needs a 48 GB NVIDIA card. My 16 GB Radeon disagrees.
r/LocalLLaMA1d ago
We all joke about our rigs being space heaters, so I had Qwen vibecode it
r/LocalLLaMA2d ago
Modify and load custom VBIOS on Windows and Linux, on Blackwell 2.0 (RTX 50 Series)/Ada(RTX 40 Series)/Ampere (RTX 30 Series) without flasing, for example to lower power limits (and which cards were tested)

r/LocalLLaMA2d ago
nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16 · Hugging Face

The Decoder3d ago
Google's Gemini 4 Argon is closer to the AI frontier than any Google model in months
r/LocalLLaMA19h ago
Calling all GPUs: help us benchmark SonicBoom v0.0.3 — a compiler-first AI runtime that beats llama.cpp on decode
r/LocalLLaMA3d ago
DeepSeek V4.1 Flash on 4x DGX Spark: my numbers vs Patrick Moorhead's results via Wccftech.

r/LocalLLaMA4d ago
FP4 QAD quant of Qwen3.8-Flash-Next from Nvidia

r/LocalLLaMA4d ago
nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB · Hugging Face

r/LocalLLaMA4d ago
Will there be a black-friday this year? NVIDIA RTX 5060 Ti 16 GB Surges Up To 144% In Japan, Hitting $1,292 As RTX 5080 Climbs Past $2,400
r/LocalLLaMA1d ago
Basalt: NVFP4 + faster prefill for Qwen3.8 Flash-Next on Blackwell (single 5090)

r/LocalLLaMA2d ago
Intel Razor Lake Ax in 2028 ruff estimate about 46 TPS on dense 27b
r/LocalLLaMA4d ago
4x R9700 builds with $127 used EPYCs: $10.7k all-in per machine. I built three (384GB VRAM)
r/LocalLLaMA5d ago
Qwen 3.8 Flash Next, DeepSeekV4 Flash and Time
r/StableDiffusion5d ago
Lora Training with Google Colab, now with Nvidia A100 as part of the AI pro plan.
r/MachineLearning2d ago
Estimating the Theoretical Parameter Capacity of a Hypothetical GPT-6-Class Model [D]

r/LocalLLaMA3d ago
cpu : reduce AVX2 tiled accumulators together by trivalik · Pull Request #30296 · ggml-org/llama.cpp
r/LocalLLaMA6d ago
PSA for 3090 FE owners: Running LLMs overheats your VRAM

r/LocalLLaMA4d ago
I turned a transformer into a game console that runs Pong, Tetris, Space Invaders and 116 more games.

NVIDIA Technical Blog6d ago
How to Rewrite Apache Spark UDFs for GPU Acceleration with AI Agents

r/LocalLLaMA4d ago
What a £300, 35W Snapdragon mini PC can actually do 👀: 35B coder at ~30 tok/s, and an 80B model that doesnt even fit in RAM running at 17 tok/s

r/StableDiffusion14h ago
11 all-in-one ComfyUI nodes I built for my own 16GB VRAM card (RTX 5060 Ti)
r/StableDiffusion1d ago
Is using an EGPU viable with ComfyUI?

r/LocalLLaMA4d ago
Add Nemotron Super 3.5 VL and Nemotron Bolt 74B A9B support by frozenblade1224 · Pull Request #30520 · ggml-org/llama.cpp
r/LocalLLaMA2d ago
Nvdia’s Nemotron is guard railed to uselessness.
r/LocalLLaMA2d ago