works on
bidirectional generation 1hybrid attention 1language model fine-tuning 1masked diffusion language modeling 1pretrained autoregressive models 1

From the 1 of 17 linked papers with an AI index.

activity
20242026
collaborators
Showing cs.OSShow all

1 paper · 1 filter

cs.OS2026

Horizon-LM: A RAM-Centric Architecture for LLM Training

Zhengqing Yuan, Lichao Sun, Yanfang Ye

The rapid growth of large language models (LLMs) has outpaced the evolution of single-GPU hardware, making model scale increasingly constrained by memory capacity rather than compu…