4 papers
Approximation Rate of the Transformer Architecture for Sequence Modeling
Haotian Jiang, Qianxiao Li
The Transformer architecture is widely applied in sequence modeling applications, yet the theoretical understanding of its working principles remains limited. In this work, we inve…
The Stochastic Proximal Distance Algorithm
Haoyu Jiang, Jason Xu
Stochastic versions of proximal methods have gained much attention in statistics and machine learning. These algorithms tend to admit simple, scalable forms, and enjoy numerical st…
Multi-Modal Experience Inspired AI Creation
Qian Cao, Xu Chen, Ruihua Song +3
AI creation, such as poem or lyrics generation, has attracted increasing attention from both industry and academic communities, with many promising models proposed in the past few…
Sparse Submodular Function Minimization
Andrei Graur, Haotian Jiang, Aaron Sidford
In this paper we study the problem of minimizing a submodular function that is guaranteed to have a -sparse minimizer. We give a deterministic a…