TensorRT-LLM

Timeline

1. Oct 17, 2026 · Tutorial / explainer · 14 sources
   Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio
   In this post, we show how to run the latest frontier-class model — Muse Spark Open, with nearly a trillion parameters — right from your desk, using the latest version of MLX, released today.
2. Oct 16, 2026 · Research paper · 1 source
   Replay Pruning and Few-Bit Integer Inference for Hardware-Efficient Speed-Sign Recognition
   Speed-limit sign recognition on an automotive camera system-on-chip (SoC) must fit a detector and a classifier (the reader) into the memory, arithmetic, and energy budgets of the device.
3. Oct 14, 2026 · Research paper · 1 source
   DefoliationCAM: An Edge-AI System for Real-Time Insect Defoliation Severity Assessment in Grapevines
   Insect-induced defoliation threatens grapevine health and yield, yet severity assessment relies on subjective manual scouting.
4. Oct 14, 2026 · Open-source release · 1 source
   NVIDIA/TensorRT-LLM v1.4.0rc0
   DeepSeek MLA models on SM120/SM121 GPUs (for example RTX PRO 6000 Blackwell) may crash with an illegal memory access when CUDA graphs are captured with BF16 BMM.
5. Oct 11, 2026 · Opinion / analysis · 1 source
   Taming the AI Hardware Cambrian Explosion — Abdul Dakkak, Modular
   Abdul Dakkak, chief scientist at Modular, explains why today's AI software stack is a mess, with vLLM, SGLang, TensorRT-LLM and llama.cpp each patching around different hardware, and how Modular rebuilt the stack from the ground up.
6. Oct 11, 2026 · Opinion / analysis · 1 source
   Updated ComfyUI-SeedVR2-VideoUpscaler-with-TensorRT v1.6.6 - Native ConvRot W4A8 Support & DisTorch2 Scope
   The other day, when I published information about v1.5.7, I received a request in the comments regarding support for w4a8.
7. Oct 1, 2026 · Tutorial / explainer · 1 source
   Build Local AI Apps with C++ and NVIDIA TensorRT RTX Samples
   Do Inference Now...Adding AI models to local applications requires a portable model format, a reliable runtime, and acceleration that works across target systems.
8. Sep 29, 2026 · Open-source release · 1 source
   AI Native by Design: Lessons Learned from Building NVIDIA TensorRT Model Connect
   Parallel work, model-family isolation, reversible changes, and GPU-backed validation shaped an open source project designed around coding agents NVIDIA TensorRT...Parallel work, model-family isolation, reversible changes, and GPU-backed validation shaped an open source project designed around coding agents NVIDIA TensorRT Model Connect is an open source collection of AI model reference implementations in C++, built on top of NVIDIA TensorRT.
9. Sep 29, 2026 · Open-source release · 1 source
   NVIDIA/TensorRT-LLM v1.3.0rc29
   Expose Nemotron-H vision-language LoRA configuration for supported inference paths #19151

Often appears with