6 citations · 6 across the 10 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2025
Provable In-Context Learning of Nonlinear Regression with Transformers
Hongbo Li, Lingjie Duan, Yingbin Liang
The transformer architecture, which processes sequences of input tokens to produce outputs for query tokens, has revolutionized numerous areas of machine learning. A defining featu…
cs.LG2024
Theory of Mixture-of-Experts for Mobile Edge Computing
Hongbo Li, Lingjie Duan
In mobile edge computing (MEC) networks, mobile users generate diverse machine learning tasks dynamically over time. These tasks are typically offloaded to the nearest available ed…
cs.LG2024
Theory on Mixture-of-Experts in Continual Learning
Hongbo Li, Sen Lin, Lingjie Duan +2
Continual learning (CL) has garnered significant attention because of its ability to adapt to new tasks that arrive over time. Catastrophic forgetting (of old tasks) has been ident…