2 papers
cs.CV2025
Understanding Space Is Rocket Science -- Only Top Reasoning Models Can Solve Spatial Understanding Tasks
Nils Hoehing, Mayug Maniparambil, Ellen Rushe +2
We propose RocketScience, an open-source contrastive VLM benchmark that tests for spatial relation understanding. It is comprised of entirely new real-world image-text pairs coveri…
cs.CV2024
Pinpoint Counterfactuals: Reducing social bias in foundation models via localized counterfactual generation
Kirill Sirotkin, Marcos Escudero-Viñolo, Pablo Carballeira +3
Foundation models trained on web-scraped datasets propagate societal biases to downstream tasks. While counterfactual generation enables bias analysis, existing methods introduce a…