2 citations · 5 across the 20 of their papers we have counts for
7 papers · 1 filter
Sharpness-Aware Minimization in Logit Space Efficiently Enhances Direct Preference Optimization
Haocheng Luo, Zehang Deng, Thanh-Toan Do +3
Direct Preference Optimization (DPO) has emerged as a popular algorithm for aligning pretrained large language models with human preferences, owing to its simplicity and training s…
Sharpness-Aware Data Generation for Zero-shot Quantization
Dung Hoang-Anh, Cuong Pham Trung Le, Jianfei Cai +1
Zero-shot quantization aims to learn a quantized model from a pre-trained full-precision model with no access to original real training data. The common idea in zero-shot quantizat…
Optimizing Specific and Shared Parameters for Efficient Parameter Tuning
Van-Anh Nguyen, Thanh-Toan Do, Mehrtash Harandi +2
Foundation models, with a vast number of parameters and pretraining on massive datasets, achieve state-of-the-art performance across various applications. However, efficiently adap…
Why Domain Generalization Fail? A View of Necessity and Sufficiency
Long-Tung Vuong, Vy Vo, Hien Dang +5
Despite a strong theoretical foundation, empirical experiments reveal that existing domain generalization (DG) algorithms often fail to consistently outperform the ERM baseline. We…
Coverage-Constrained Human-AI Cooperation with Multiple Experts
Zheng Zhang, Cuong Nguyen, Kevin Wells +3
Human-AI cooperative classification (HAI-CC) approaches aim to develop hybrid intelligent systems that enhance decision-making in various high-stakes real-world scenarios by levera…
Model and Feature Diversity for Bayesian Neural Networks in Mutual Learning
Cuong Pham, Cuong C. Nguyen, Trung Le +3
Bayesian Neural Networks (BNNs) offer probability distributions for model parameters, enabling uncertainty quantification in predictions. However, they often underperform compared…
Agnostic Sharpness-Aware Minimization
Van-Anh Nguyen, Quyen Tran, Tuan Truong +3
Sharpness-aware minimization (SAM) has been instrumental in improving deep neural network training by minimizing both the training loss and the sharpness of the loss landscape, lea…