activity
20202026
most citedFlamingo: a Visual Language Model for Few-Shot Learning

1.3k citations · 1.3k across the 7 of their papers we have counts for

collaborators

9 papers

cs.LG2026

Kastor: An efficient fine-tuning strategy for generative emulation of PDE simulations

Guillaume Couairon, Alexis Jacq, Yu-Han Wu +4

Machine learning offers a promising avenue to accelerate physical simulations by replacing computationally expensive traditional Partial Differential Equation (PDE) solvers with fa…

physics.ao-ph2026

Evaluating Skill and Stability of ArchesWeather and ArchesWeatherGen under Multi-Decadal Climate Simulations

Renu Singh, Robert Brunstein, Antonia Jost +5

We evaluate the climate simulation capabilities of ArchesWeather and ArchesWeatherGen, two machine learning models originally trained for weather forecasting and evaluated up to a…

physics.ao-ph2026★ 1 cited

AIMIP Phase 1: systematic evaluations of AI weather and climate models

Brian Henn, Christopher S. Bretherton, Nikolay Koldunov +18

We present the AI weather and climate model intercomparison project (AIMIP), phase 1. Drawing from the rich tradition of intercomparisons in climate model development, we specify a…

cs.CV2025

SciVid: Cross-Domain Evaluation of Video Models in Scientific Applications

Yana Hasson, Pauline Luc, Liliane Momeni +10

In recent years, there has been a proliferation of spatiotemporal foundation models in different scientific disciplines. While promising, these models are often domain-specific and…

cs.CV2024

Scaling 4D Representations

João Carreira, Dilara Gokay, Michael King +32

Scaling has not yet been convincingly demonstrated for pure self-supervised learning from video. However, prior work has focused evaluations on semantic-related tasks $\unicode{x20…

cs.LG2024

Neural Compression of Atmospheric States

Piotr Mirowski, David Warde-Farley, Mihaela Rosca +7

Atmospheric states derived from reanalysis comprise a substantial portion of weather and climate simulation outputs. Many stakeholders -- such as researchers, policy makers, and in…

cs.CV2024

GenEARL: A Training-Free Generative Framework for Multimodal Event Argument Role Labeling

Hritik Bansal, Po-Nien Kung, P. Jeffrey Brantingham +2

Multimodal event argument role labeling (EARL), a task that assigns a role for each event participant (object) in an image is a complex challenge. It requires reasoning over the en…

cs.CV2022★ 1.3k cited

Flamingo: a Visual Language Model for Few-Shot Learning

Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc +24

Building models that can be rapidly adapted to novel tasks using only a handful of annotated examples is an open challenge for multimodal machine learning research. We introduce Fl…

cs.CV2020

Low Bandwidth Video-Chat Compression using Deep Generative Models

Maxime Oquab, Pierre Stock, Oran Gafni +9

To unlock video chat for hundreds of millions of people hindered by poor connectivity or unaffordable data costs, we propose to authentically reconstruct faces on the receiver's de…