3 citations · 3 across the 5 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2023
LayerCollapse: Adaptive compression of neural networks
Soheil Zibakhsh Shabgahi, Mohammad Sohail Shariff, Farinaz Koushanfar
Handling the ever-increasing scale of contemporary deep learning and transformer-based models poses a significant challenge. Overparameterized Transformer networks outperform prior…
cs.LG2023
LiveTune: Dynamic Parameter Tuning for Feedback-Driven Optimization
Soheil Zibakhsh Shabgahi, Nojan Sheybani, Aiden Tabrizi +1
Feedback-driven optimization, such as traditional machine learning training, is a static process that lacks real-time adaptability of hyperparameters. Tuning solutions for optimiza…