2 papers
cs.LG2024
BlockLLM: Memory-Efficient Adaptation of LLMs by Selecting and Optimizing the Right Coordinate Blocks
Amrutha Varshini Ramesh, Vignesh Ganapathiraman, Issam H. Laradji +1
Training large language models (LLMs) for pretraining or adapting to new tasks and domains has become increasingly critical as their applications expand. However, as the model and…
cs.LG2020
Convex Representation Learning for Generalized Invariance in Semi-Inner-Product Space
Yingyi Ma, Vignesh Ganapathiraman, Yaoliang Yu +1
Invariance (defined in a general sense) has been one of the most effective priors for representation learning. Direct factorization of parametric models is feasible only for a smal…