19 citations · 20 across the 6 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.AI2023
Systematic Investigation of Sparse Perturbed Sharpness-Aware Minimization Optimizer
Peng Mi, Li Shen, Tianhe Ren +6
Deep neural networks often suffer from poor generalization due to complex and non-convex loss landscapes. Sharpness-Aware Minimization (SAM) is a popular solution that smooths the…
cs.CL2023
State space models can express n-gram languages
Vinoth Nandakumar, Qiang Qu, Peng Mi +1
Recent advancements in recurrent neural networks (RNNs) have reinvigorated interest in their application to natural language processing tasks, particularly with the development of…