Observation Assimilation Transformer: Probabilistic Weather Analysis from Sparse Station Observations
We present the Observation Assimilation Transformer (OAT), a geometry-aware neural process that corrects and refines a prior numerical weather prediction (NWP) field into a high-resolution posterior field by assimilating sparse observations.
ProofPaper ↗
Key points
- OAT is an encoder-decoder transformer that considers a set of observed locations and their NWP prior to condition predictions at a set of arbitrary unobserved query locations.
- A station-randomized training algorithm is developed with continuous ranked probability score (CRPS) loss.
- We test OAT on two datasets - one at regional scale with hundreds of stations, and one at continental scale with thousands of stations.
- In an illustrative case study, OAT's downscaling capabilities are demonstrated by downscaling ERA5 ( 31km) to COSMO (1km), where OAT achieves lower mean absolute error (MAE) and CRPS for temperature and precipitation on test stations compared to COSMO.
Sources (1)
- [1]Observation Assimilation Transformer: Probabilistic Weather Analysis from Sparse Station ObservationsarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 20, 03:00 PM
We present the Observation Assimilation Transformer (OAT), a geometry-aware neural process that corrects and refines a prior numerical weather prediction (NWP) field into a high-resolution posterior field by assimilating sparse observations.
OAT is an encoder-decoder transformer that considers a set of observed locations and their NWP prior to condition predictions at a set of arbitrary unobserved query locations.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 20, 2026unsloth/flint-GGUF
- Oct 20, 2026unsloth/sam3.1
- Oct 20, 2026MPS in PyTorch 2.15
- Oct 19, 2026XHToken/Spark-X2.6-4B
- Oct 19, 2026TorchNeuron: running HF models on AWS Trainium is easier than ever
- Oct 19, 2026SpecKCast: Spectral Kalman Forecasting for Diffusion Acceleration