Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
How Does the Spatial Distribution of Pre-training Data Affect Geospatial Foundation Models?
Mirali Purohit, Gedeon Muhawenayo, Esther Rolf +1
Foundation models have made rapid advances in many domains including Earth observation, where Geospatial Foundation Models (GFMs) can help address global challenges such as climate…
cs.LG2024
An All-MLP Sequence Modeling Architecture That Excels at Copying
Chenwei Cui, Zehao Yan, Gedeon Muhawenayo +1
Recent work demonstrated Transformers' ability to efficiently copy strings of exponential sizes, distinguishing them from other architectures. We present the Causal Relation Networ…