13 citations · 18 across the 14 of their papers we have counts for
3 papers · 1 filter
Efficient Model-Agnostic Multi-Group Equivariant Networks
Razan Baltaji, Sourya Basu, Lav R. Varshney
Constructing model-agnostic group equivariant networks, such as equitune (Basu et al., 2023b) and its generalizations (Kim et al., 2023), can be computationally expensive for large…
Transformers are Universal Predictors
Sourya Basu, Moulik Choraria, Lav R. Varshney
We find limits to the Transformer architecture for language modeling and show it has a universal prediction property in an information-theoretic sense. We further analyze performan…
Efficient Equivariant Transfer Learning from Pretrained Models
Sourya Basu, Pulkit Katdare, Prasanna Sattigeri +4
Efficient transfer learning algorithms are key to the success of foundation models on diverse downstream tasks even with limited data. Recent works of Basu et al. (2023) and Kaba e…