3 citations · 3 across the 7 of their papers we have counts for
8 papers
Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus
Zunhai Su, Bohan Sun, Xialie Zhuang +8
We present the first systematic study of Massive activations (MAs) in layer-interleaved HLA LLMs and uncover two architecture-aligned morphologies: MAs consistently spike immediate…
Are Diffusion Language Models Good Database Analysts?
Peixian Ma, Xialie Zhuang, Jiantao Tan +3
Recent advancements in large language models (LLMs) have significantly improved Natural Language to SQL (NL2SQL) tasks, yet most NL2SQL systems continue to rely on the autoregressi…
OScaR: The Occam's Razor for Extreme KV Cache Quantization in LLMs and Beyond
Zunhai Su, Rui Yang, Chao Zhang +11
The rapid advancement toward long-context reasoning and multi-modal intelligence has made the memory footprint of the Key-Value (KV) cache a dominant memory bottleneck for efficien…
EpochX: Building the Infrastructure for an Emergent Agent Civilization
Huacan Wang, Chaofa Yuan, Xialie Zhuang +15
General-purpose technologies reshape economies less by improving individual tools than by enabling new ways to organize production and coordination. We believe AI agents are approa…
Effective Learning for Small Reasoning Models: An Empirical Study on 0.5B Reasoning LLMs
Xialie Zhuang, Peixian Ma, Zhikai Jia +2
The ongoing evolution of language models has led to the development of large-scale architectures that demonstrate exceptional performance across a wide range of tasks. However, the…
ReEx-SQL: Reasoning with Execution-Aware Reinforcement Learning for Text-to-SQL
Yaxun Dai, Wenxuan Xie, Xialie Zhuang +6
In Text-to-SQL, execution feedback is essential for guiding large language models (LLMs) to reason accurately and generate reliable SQL queries. However, existing methods treat exe…