3 citations · 5 across the 14 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.CL2024
Reducing Distraction in Long-Context Language Models by Focused Learning
Zijun Wu, Bingyuan Liu, Ran Yan +2
Recent advancements in Large Language Models (LLMs) have significantly enhanced their capacity to process long contexts. However, effectively utilizing this long context remains a…
cs.DC2024★ 2 cited
HexiScale: Facilitating Large Language Model Training over Heterogeneous Hardware
Ran Yan, Youhe Jiang, Xiaonan Nie +3
Training large language models (LLMs) is a computationally intensive task, which is typically conducted in data centers with homogeneous high-performance GPUs. In this paper, we ex…