What a £300, 35W Snapdragon mini PC can actually do 👀: 35B coder at ~30 tok/s, and an 80B model that doesnt even fit in RAM running at 17 tok/s

Key points

• Qwen3.6 35B A3B coder: reads ~118 tok/s, writes 24.5, ~30 with MTP1
• So I bought one of these boxes to test if software at work would run on ARM Windows - and then it was sitting there, but I was sufficiently impressed for the price (including taxes), that i decided in my ADHD fuelled boredom to buy one for myself to see if cheap ARM is actually usable for local models.1
• The GPU is an Adreno X1-45 and nothing useful runs on it for LLMs yet, and so far the NPU just sits there, so this is all CPU...1
• RAM is the wall on 32GB, so I went looking at the recently released Janas (github.com/prabanta-dev/janas).1

Sources (1)

• [1]What a £300, 35W Snapdragon mini PC can actually do 👀: 35B coder at ~30 tok/s, and an 80B model that doesnt even fit in RAM running at 17 tok/s
  r/LocalLLaMA (top, daily) · Oct 15, 06:02 PM

  £299.99 Lenovo IdeaCentre Mini (Snapdragon X1-26-100, 32GB, CPU only):

  - Qwen3.6 35B A3B coder: reads ~118 tok/s, writes 24.5, ~30 with MTP

Extractive summary: sentences quoted from the sources.