8 papers
On the Implicit Flatness Bias of Sharpness-Aware Minimization: A Linear Stability Analysis with Quantitative Hyperparameter Bounds
Jiaxin Deng, Junbiao Pang
Sharpness-Aware Minimization (SAM) improves generalization by seeking parameters whose loss is robust to local adversarial perturbations, but the quantitative mechanism underlying…
From Perturbation Correction to Geometry-Aware Sampling: Sharpness-Guided Equilibrium Sampling for Balanced Flat Minima in Long-Tailed Learning
Jiaxin Deng, Junbiao Pang
Long-tailed learning couples two sources of poor generalization: head classes dominate training exposure, while under-represented classes often converge to sharper regions of the l…
Gradient-Energy Guided Block-Wise Perturbations for Sharpness-Aware Minimization
Zhen Huang, Jiaxin Deng, Junbiao Pang
Sharpness-Aware Minimization (SAM) improves generalization by minimizing the worst-case loss in a local parameter neighborhood. Standard SAM implicitly allocates its global perturb…
Efficiently Seeking Flat Minima for Better Generalization in Fine-Tuning Large Language Models and Beyond
Jiaxin Deng, Qingcheng Zhu, Junbiao Pang +3
Little research explores the correlation between the expressive ability and generalization ability of the low-rank adaptation (LoRA). Sharpness-Aware Minimization (SAM) improves mo…
Importance-aware Topic Modeling for Discovering Public Transit Risk from Noisy Social Media
Fatima Ashraf, Muhammad Ayub Sabir, Jiaxin Deng +2
Urban transit agencies increasingly turn to social media to monitor emerging service risks such as crowding, delays, and safety incidents, yet the signals of concern are sparse, sh…
Rectify and Align GPS Points to Parking Spots via Rank-1 Constraint
Jiaxing Deng, Junbiao Pang, Zhicheng Wang +1
Parking spots are essential components, providing vital mobile resources for residents in a city. Accurate Global Positioning System (GPS) points of parking spots are the core data…