1 citations · 1 across the 5 of their papers we have counts for
5 papers
MATCH: Modulating Attention via In-Context Retrieval for Long-Context Transformers
Linrui Ma, Chun Hei Lo, Xinyu Wang +12
The quadratic computational cost of traditional attention mechanisms poses a major bottleneck to the scalability and practical deployment of large language models (LLMs), particula…
Whole-Body Inverse Kinematics with Graph Diffusion
Helong Huang, Kai Tan, Feng Wen +2
Inverse kinematics (IK) is a fundamental problem in robotics, requiring the generation of joint configurations that satisfy target end-effector poses. Existing approaches often str…
Do World Action Models Generalize Better than VLAs? A Robustness Study
Zhanguang Zhang, Zhiyuan Li, Behnam Rahmati +11
Robot action planning in the real world is challenging as it requires not only understanding the current state of the environment but also predicting how it will evolve in response…
Top 10 Open Challenges Steering the Future of Diffusion Language Model and Its Variants
Yunhe Wang, Kai Han, Huiling Zhen +13
The paradigm of Large Language Models (LLMs) is currently defined by auto-regressive (AR) architectures, which generate text through a sequential ``brick-by-brick'' process. Despit…
MindStar: Enhancing Math Reasoning in Pre-trained LLMs at Inference Time
Jikun Kang, Xin Zhe Li, Xi Chen +9
Although Large Language Models (LLMs) achieve remarkable performance across various tasks, they often struggle with complex reasoning tasks, such as answering mathematical question…