4 papers · 1 filter
Concentration of Regularized Sparse Random Matrices: Spectral Edge Bounds via Nonbacktracking Operators
Hai-Xiao Wang
In sparse random matrices, spectral outliers (eigenvalues and singular values located away from the bulk) emerge due to degree fluctuations: high degrees inflate the operator norm,…
Majority Dynamics on Resampled Sparse Erdős--Rényi Graphs: Gaussian Winner Selection in Collaborative Agent Networks
Ioana Dumitriu, Muchen Ju, Hai-Xiao Wang
Collective decisions in agent networks emerge from repeated local interactions, as agents update their opinions (colors) based on their neighbors, potentially leading to consensus.…
Majority Dynamics on Assortative Sparse Stochastic Block Models
Ioana Dumitriu, Muchen Ju, Hai-Xiao Wang
Majority dynamics is a two-opinion process in which each vertex repeatedly updates to the majority opinion among its neighbors. We study this process on a resampled sparse binary s…
Attention Mechanisms Through the Lens of Numerical Methods: Approximation Methods and Alternative Formulations
Michel Fabrice Serret, Alice Cortinovis, Yijun Dong +10
The attention mechanism is the computational core of modern Transformer architectures, but its quadratic complexity in the input sequence length is the bottleneck for large-scale i…