ResearchResearch paperTraining & Scaling · Efficiency & Inference1 source · Oct 20, 2026

Geometry-Aware Block Selection for Sparse Variational Gaussian Processes

Sparse variational Gaussian processes (SVGPs) are a widely used, principled approach to scalable Gaussian process modelling.

Key points

  • In particular, introducing a block-diagonal structured scal- ing matrix leads to a tighter lower bound on the GP marginal likelihood.
  • We investigate whether selecting blocks that tighten the variational objective improves test RMSE and NLL at a fixed inducing-point budget.
  • Since the scaling matrix contributes to the variational lower bound through an upper bound on the log-determinant of the full residual covariance matrix, our work makes the following contributions.
  • First, we introduce a simple, scalable, geometry-aware algorithm, with explicit computational complexity and low computational overhead, that recovers a large fraction of this log- determinant contribution by selecting an appropriate partition of the data.

Sources (1)

  • [1]Geometry-Aware Block Selection for Sparse Variational Gaussian Processes
    arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 20, 02:12 PM
    Sparse variational Gaussian processes (SVGPs) are a widely used, principled approach to scalable Gaussian process modelling.
    In particular, introducing a block-diagonal structured scal- ing matrix leads to a tighter lower bound on the GP marginal likelihood.

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 20, 2026Large Flow Language Models
  2. Oct 19, 2026Push-based KV transfer to improve TTFT and TPOT for disaggregated inference in vLLM
  3. Oct 19, 2026Improve TTFT for multi-turn agentic workloads with bi-directional KV transfer in vLLM
  4. Oct 19, 2026NVIDIA Cosmos3-H-Dreams: Bringing Clinical Surgery to Life Through Generative Simulation
  5. Oct 19, 2026jax-ml/jax jax-v0.12.0: JAX v0.12.0
  6. Oct 19, 2026AI researchers stranded Claude on a virtual desert island. It started to “play.”

Related