Showing cs.LGShow all
2 papers · 1 filter
cs.LG2024
Natural GaLore: Accelerating GaLore for memory-efficient LLM Training and Fine-tuning
Arijit Das
Training LLMs presents significant memory challenges due to growing size of data, weights, and optimizer states. Techniques such as data and model parallelism, gradient checkpointi…
cs.LG2024
Online Learning under Haphazard Input Conditions: A Comprehensive Review and Analysis
Rohit Agarwal, Arijit Das, Alexander Horsch +2
The domain of online learning has experienced multifaceted expansion owing to its prevalence in real-life applications. Nonetheless, this progression operates under the assumption…