Weather downscaling usually improves spatial detail for a given time; forecasting adds the harder requirement of evolving that detail into the future. This work treats both as one problem and finds that a carefully structured low-rank update can outperform broader adaptation while training fewer than 4 million parameters in its main setting.
Key Findings
- The method splits a fixed low-rank budget between directions already prominent in pretrained weights and an orthogonal branch for new corrections. This lets adaptation reuse learned structure without restricting all updates to it.
- On global weather downscaling, it reports lower RMSE than the evaluated low-rank baselines across five variables at both 3-hour and 6-hour leads. It also surpasses full fine-tuning on selected variables and leads, despite using 3.92 million trainable parameters—under 0.4% of the full fine-tuning parameter count.
- The reported gains extend to ERA5-to-CERRA regional downscaling and regional precipitation forecasting, suggesting the approach is not limited to one global benchmark.
- Gradient-guided rescaling adjusts rank-1 optimizer updates without increasing the trainable rank, targeting more effective use of a constrained adaptation budget.
Method and Scope
The prediction pipeline separates spatial refinement from temporal prediction, using a shared pretrained weather backbone, fixed numerical scaffolds, and lightweight residual heads. PROLA changes how that backbone is adapted; it is not a replacement forecasting architecture. The experiments compare it with methods including LoRA, PiSSA, OPLoRA, and AdaLoRA under their reported settings.
Who It Suits—and the Trade-off
A useful read for researchers adapting pretrained geophysical models under tight training or parameter budgets, especially when both forecast horizon and spatial resolution matter. The evidence is empirical and tied to the paper’s evaluated datasets, variables, and protocols; it does not establish gains for every weather model or deployment setting. Readers seeking a general-purpose forecasting system rather than a parameter-efficient adaptation method should look elsewhere.