Spatial Adapter: Structured Spatial Decomposition and Closed-Form Covariance for Frozen Predictors
Authors: Wen-Ting Wang, Wei-Ying Wu, Hao-Yun Huang et al.
Summary
The authors designed a plug-in layer (the "Spatial Adapter") that sits on top of any frozen model and learns a compressed spatial summary of the model's prediction errors. The layer represents the residual field using an orthonormal basis plus per-sample scores, learned via mini-batch optimization, and produces a closed-form estimate of how errors are spatially correlated—enabling predictions at new locations with uncertainty estimates. Because the original model stays frozen, this is strictly a post-hoc add-on that doesn't retrain the backbone.
Main takeaways:
- Attaches to any frozen predictor (linear, deep vision, or spatiotemporal) without retraining it, purely to model the leftover errors
- Learns a structured low-rank decomposition of residual spatial patterns plus a covariance estimate, so you can predict at unobserved locations and quantify uncertainty
- Uses fewer than K(N+T) parameters (K is an upper bound on rank, N is spatial dimension, T is time steps) plus a small residual network
- Tested on synthetic data, Weather2K spatial-holdout forecasting, and GWHD patch grids; recovers spatial structure across all backbone types
- The effective rank is chosen adaptively by spectral thresholding rather than fixed in advance
Relevance
Not directly related to my persona/midtraining work—this is a spatial-statistics method for modeling prediction errors. Only tangentially relevant if I ever need uncertainty quantification or post-hoc adaptation layers that preserve a frozen backbone.
Abstract
arXiv:2605.11394v1 Announce Type: new Abstract: We present the Spatial Adapter, a parameter-efficient post-hoc layer that equips any frozen first-stage predictor with a structured spatial representation of its residual field and an induced closed-form spatial covariance. The adapter operates as a cascade second stage on residuals, jointly learning a spatially regularized orthonormal basis and per-sample scores via a tractable mini-batch ADMM procedure, without modifying any first-stage parameter. Because the first-stage parameters are frozen, the adapter does not retrain the backbone; its role is to supply a compressed distributional summary of the residual field. Smoothness, sparsity, and orthogonality together turn a generic low-rank factorization into an identifiable spatial representation whose induced residual covariance admits a closed-form low-rank-plus-noise estimator; the effective rank is determined data-adaptively by spectral thresholding, while the nominal rank K is an optimization-side upper bound only. This covariance enables kriging-style spatial prediction at unobserved locations, with plug-in uncertainty quantification as a secondary downstream use. Across synthetic data, Weather2K for spatial-holdout prediction, and GWHD patch grids as a basis-transferability diagnostic, the adapter recovers residual spatial structure when paired with frozen first stages from linear models to deep spatiotemporal and vision backbones; the added representation uses fewer than K(N+T) parameters alongside a compact residual-trend network.