2 citations · 3 across the 3 of their papers we have counts for
3 papers
Hyperparameter Optimization for Large Language Model Instruction-Tuning
Christophe Tribes, Sacha Benarroch-Lelong, Peng Lu +1
The fine-tuning of Large Language Models (LLMs) has enabled them to recently achieve milestones in natural language processing applications. The emergence of ever larger LLMs has p…
Efficient Training Under Limited Resources
Mahdi Zolnouri, Dounia Lakhmiri, Christophe Tribes +2
Training time budget and size of the dataset are among the factors affecting the performance of a Deep Neural Network (DNN). This paper shows that Neural Architecture Search (NAS),…
Scaling Deep Networks with the Mesh Adaptive Direct Search algorithm
Dounia Lakhmiri, Mahdi Zolnouri, Vahid Partovi Nia +2
Deep neural networks are getting larger. Their implementation on edge and IoT devices becomes more challenging and moved the community to design lighter versions with similar perfo…