5 citations · 6 across the 6 of their papers we have counts for
3 papers · 1 filter
Online Distributional Prediction via Latent Cluster Geometry Under Drift and Corruption
Navyansh Mahla, Prateek Chanda, Ganesh Ramakrishnan
Online learning in non-stationary streams is often formulated as tracking a point estimate, although many applications require predicting the full data-generating distribution. We…
Sequential Compression Layers for Efficient Federated Learning in Foundational Models
Navyansh Mahla, Sunny Gupta, Amit Sethi
Federated Learning (FL) has gained popularity for fine-tuning large language models (LLMs) across multiple nodes, each with its own private data. While LoRA has been widely adopted…
Exploring Gradient Subspaces: Addressing and Overcoming LoRA's Limitations in Federated Fine-Tuning of Large Language Models
Navyansh Mahla, Kshitij Sharad Jadhav, Ganesh Ramakrishnan
Large Language Models (LLMs) have demonstrated remarkable capabilities across various domains, particularly in task generalization for both text and vision data. While fine-tuning…