WeatherFormer: A Pretrained Encoder Model for Learning Robust Weather Representations from Small Datasets

Adib Hasan, Mardavij Roozbehani, Munther Dahleh

This paper introduces WeatherFormer, a transformer encoder-based model designed to learn robust weather features from minimal observations. It addresses the challenge of modeling c…