On the Limits of Scale: Inverse Scaling in Vision-Language Models

Rohit Saxena, Alessandro Suglia, Marek Rei +1

Scaling laws suggest that increasing model size, training data, and compute generally yields monotonic performance improvements. While this often holds at the aggregate level, we p…