3 citations · 3 across the 13 of their papers we have counts for
15 papers
On the Implicit Flatness Bias of Sharpness-Aware Minimization: A Linear Stability Analysis with Quantitative Hyperparameter Bounds
Jiaxin Deng, Junbiao Pang
Sharpness-Aware Minimization (SAM) improves generalization by seeking parameters whose loss is robust to local adversarial perturbations, but the quantitative mechanism underlying…
From Perturbation Correction to Geometry-Aware Sampling: Sharpness-Guided Equilibrium Sampling for Balanced Flat Minima in Long-Tailed Learning
Jiaxin Deng, Junbiao Pang
Long-tailed learning couples two sources of poor generalization: head classes dominate training exposure, while under-represented classes often converge to sharper regions of the l…
Gradient-Energy Guided Block-Wise Perturbations for Sharpness-Aware Minimization
Zhen Huang, Jiaxin Deng, Junbiao Pang
Sharpness-Aware Minimization (SAM) improves generalization by minimizing the worst-case loss in a local parameter neighborhood. Standard SAM implicitly allocates its global perturb…
Importance-aware Topic Modeling for Discovering Public Transit Risk from Noisy Social Media
Fatima Ashraf, Muhammad Ayub Sabir, Jiaxin Deng +2
Urban transit agencies increasingly turn to social media to monitor emerging service risks such as crowding, delays, and safety incidents, yet the signals of concern are sparse, sh…
Rectify and Align GPS Points to Parking Spots via Rank-1 Constraint
Jiaxing Deng, Junbiao Pang, Zhicheng Wang +1
Parking spots are essential components, providing vital mobile resources for residents in a city. Accurate Global Positioning System (GPS) points of parking spots are the core data…
Adaptively Sampling-Reusing-Mixing Decomposed Gradients to Speed Up Sharpness Aware Minimization
Jiaxin Deng, Junbiao Pang
Sharpness-Aware Minimization (SAM) improves model generalization but doubles the computational cost of Stochastic Gradient Descent (SGD) by requiring twice the gradient calculation…
Efficiently Seeking Flat Minima for Better Generalization in Fine-Tuning Large Language Models and Beyond
Jiaxin Deng, Qingcheng Zhu, Junbiao Pang +3
Little research explores the correlation between the expressive ability and generalization ability of the low-rank adaptation (LoRA). Sharpness-Aware Minimization (SAM) improves mo…
Unsupervised Abnormal Stop Detection for Long Distance Coaches with Low-Frequency GPS
Jiaxin Deng, Junbiao Pang, Jiayu Xu +1
In our urban life, long distance coaches supply a convenient yet economic approach to the transportation of the public. One notable problem is to discover the abnormal stop of the…
Modeling the Popularity of Events on Web by Sparsity and Mutual-Excitation Guided Graph Neural Network
Jiaxin Deng, Linlin Jia, Junbiao Pang +1
The content of a webpage described or posted an event in the cyberspace inevitably reflects viewpoints, values and trends of the physical society. Mapping an event on web to the po…
Bilateral Sharpness-Aware Minimization for Flatter Minima
Jiaxin Deng, Junbiao Pang, Baochang Zhang +1
Sharpness-Aware Minimization (SAM) enhances generalization by reducing a Max-Sharpness (MaxS). Despite the practical success, we empirically found that the MAxS behind SAM's genera…
Asymptotic Unbiased Sample Sampling to Speed Up Sharpness-Aware Minimization
Jiaxin Deng, Junbiao Pang, Baochang Zhang
Sharpness-Aware Minimization (SAM) has emerged as a promising approach for effectively reducing the generalization error. However, SAM incurs twice the computational cost compared…
Pixel-Wise Symbol Spotting via Progressive Points Location for Parsing CAD Images
Junbiao Pang, Zailin Dong, Jiaxin Deng +2
Parsing Computer-Aided Design (CAD) drawings is a fundamental step for CAD revision, semantic-based management, and the generation of 3D prototypes in both the architecture and eng…
Effective Gradient Sample Size via Variation Estimation for Accelerating Sharpness aware Minimization
Jiaxin Deng, Junbiao Pang, Baochang Zhang +1
Sharpness-aware Minimization (SAM) has been proposed recently to improve model generalization ability. However, SAM calculates the gradient twice in each optimization step, thereby…
ContentCTR: Frame-level Live Streaming Click-Through Rate Prediction with Multimodal Transformer
Jiaxin Deng, Dong Shen, Shiyao Wang +4
In recent years, live streaming platforms have gained immense popularity as they allow users to broadcast their videos and interact in real-time with hosts and peers. Due to the dy…
A Unified Model for Video Understanding and Knowledge Embedding with Heterogeneous Knowledge Graph Dataset
Jiaxin Deng, Dong Shen, Haojie Pan +7
Video understanding is an important task in short video business platforms and it has a wide application in video recommendation and classification. Most of the existing video unde…