24 citations · 70 across the 8 of their papers we have counts for
3 papers · 1 filter
Broken Neural Scaling Laws
Ethan Caballero, Kshitij Gupta, Irina Rish +1
We present a smoothly broken power law functional form (that we refer to as a Broken Neural Scaling Law (BNSL)) that accurately models & extrapolates the scaling behaviors of deep…
cViL: Cross-Lingual Training of Vision-Language Models using Knowledge Distillation
Kshitij Gupta, Devansh Gautam, Radhika Mamidi
Vision-and-language tasks are gaining popularity in the research community, but the focus is still mainly on English. We propose a pipeline that utilizes English-only vision-langua…
Temporal Latent Bottleneck: Synthesis of Fast and Slow Processing Mechanisms in Sequence Learning
Aniket Didolkar, Kshitij Gupta, Anirudh Goyal +4
Recurrent neural networks have a strong inductive bias towards learning temporally compressed representations, as the entire history of a sequence is represented by a single vector…