10 citations · 16 across the 9 of their papers we have counts for
9 papers
How to Inverting the Leverage Score Distribution?
Zhihang Li, Zhao Song, Weixin Wang +2
Leverage score is a fundamental problem in machine learning and theoretical computer science. It has extensive applications in regression analysis, randomized algorithms, and neura…
The Expressibility of Polynomial based Attention Scheme
Zhao Song, Guangyi Xu, Junze Yin
Large language models (LLMs) have significantly improved various aspects of our daily lives. These models have impacted numerous domains, from healthcare to education, enhancing pr…
A Unified Scheme of ResNet and Softmax
Zhao Song, Weixin Wang, Junze Yin
Large language models (LLMs) have brought significant changes to human society. Softmax regression and residual neural networks (ResNet) are two important techniques in deep learni…
A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time
Yeqi Gao, Zhao Song, Weixin Wang +1
Large language models (LLMs) have played a pivotal role in revolutionizing various facets of our daily existence. Solving attention regression is a fundamental task in optimizing L…
Dynamical Fractal: Theory and Case Study
Junze Yin
Urbanization is a phenomenon of concern for planning and public health: projections are difficult because of policy changes and natural events, and indicators are multiple. There a…
Query Complexity of Active Learning for Function Family With Nearly Orthogonal Basis
Xiang Chen, Zhao Song, Baocheng Sun +2
Many machine learning algorithms require large numbers of labeled data to deliver state-of-the-art results. In applications such as medical diagnosis and fraud detection, though th…