9 citations · 9 across the 4 of their papers we have counts for
4 papers
Fixed Universal Transformers
Jingwen Liu, Alexandr Andoni, Daniel Hsu
We introduce \emph{universal transformers}: fixed transformers that can simulate any transformer in a given class via a suitable input embedding. Analogous to a universal Turing ma…
Fast attention mechanisms: a tale of parallelism
Jingwen Liu, Hantao Yu, Clayton Sanford +2
Transformers have the representational capacity to simulate Massively Parallel Computation (MPC) algorithms, but they suffer from quadratic time complexity, which severely limits t…
Group-wise oracle-efficient algorithms for online multi-group learning
Samuel Deng, Daniel Hsu, Jingwen Liu
We study the problem of online multi-group learning, a learning model in which an online learner must simultaneously achieve small prediction regret on a large collection of (possi…
On the Opportunities of Green Computing: A Survey
You Zhou, Xiujing Lin, Xiang Zhang +38
Artificial Intelligence (AI) has achieved significant advancements in technology and research with the development over several decades, and is widely used in many areas including…