activity
20222025
most citedFew-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning

294 citations · 300 across the 6 of their papers we have counts for

collaborators
Showing 2023Show all

2 papers · 1 filter

cs.LG2023★ 5 cited

Git-Theta: A Git Extension for Collaborative Development of Machine Learning Models

Nikhil Kandpal, Brian Lester, Mohammed Muqeeth +6

Currently, most machine learning models are trained by centralized teams and are rarely updated. In contrast, open-source software development involves the iterative development of…

cs.LG2023

Soft Merging of Experts with Adaptive Routing

Mohammed Muqeeth, Haokun Liu, Colin Raffel

Sparsely activated neural networks with conditional computation learn to route their inputs through different "expert" subnetworks, providing a form of modularity that densely acti…