ResearchResearch paperInterpretability · Training & Scaling1 source · Oct 21, 2026

Distilling Multi-Teacher Scoring Principles for Unsupervised Time Series Anomaly Detection

We study whether heterogeneous teacher detectors can be distilled into a single lightweight detector in the unsupervised setting, where no anomaly labels are available to define a shared target.

Key points

  • Time series anomalies take diverse forms, and individual detectors encode different anomaly scoring principles that rarely cover all anomaly types.
  • Recent unsupervised time-series anomaly detectors provide complementary scoring signals, yet deploying them as an ensemble preserves the inference and maintenance cost of every individual detector.
  • AnoMix addresses this by extracting weak pairwise supervision from the training-set anomaly scores of frozen teachers.
  • A zero-shot variant further shows that the distilled ranking signal transfers to unseen datasets and can outperform large pretrained time-series foundation models for anomaly detection.

Sources (1)

  • [1]Distilling Multi-Teacher Scoring Principles for Unsupervised Time Series Anomaly Detection
    arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 21, 01:42 AM
    We study whether heterogeneous teacher detectors can be distilled into a single lightweight detector in the unsupervised setting, where no anomaly labels are available to define a shared target.
    Time series anomalies take diverse forms, and individual detectors encode different anomaly scoring principles that rarely cover all anomaly types.

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 20, 2026SolarRenderer: Few-Step Generative Reference Rendering
  2. Oct 20, 2026SuperMimic: Scaling Humanoid Whole-Body Control with One Differentiable World Model
  3. Oct 20, 2026Gradium Open-Sources Phonon, a 31M-Parameter On-Device TTS Model Under Apache 2.0
  4. Oct 20, 2026Matrix-Game 4.0: Harnessing Video Models for Real-Time Playable Game Worlds
  5. Oct 19, 2026How Deepgram optimized voice AI at scale with AWS Trainium
  6. Oct 19, 2026NVIDIA Cosmos3-H-Dreams: Bringing Clinical Surgery to Life Through Generative Simulation

Related