7 citations · 8 across the 4 of their papers we have counts for
3 papers · 1 filter
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts
Qizhen Zhang, Nikolas Gritsch, Dwaraknath Gnaneshwar +8
The Mixture of Experts (MoE) framework has become a popular architecture for large language models due to its superior performance over dense models. However, training MoEs from sc…
Score-Based Generative Models for Molecule Generation
Dwaraknath Gnaneshwar, Bharath Ramsundar, Dhairya Gandhi +2
Recent advances in generative models have made exploring design spaces easier for de novo molecule generation. However, popular generative models like GANs and normalizing flows fa…
Know Where To Drop Your Weights: Towards Faster Uncertainty Estimation
Akshatha Kamath, Dwaraknath Gnaneshwar, Matias Valdenegro-Toro
Estimating epistemic uncertainty of models used in low-latency applications and Out-Of-Distribution samples detection is a challenge due to the computationally demanding nature of…