17 citations · 17 across the 3 of their papers we have counts for
4 papers · 1 filter
Fisher-Guided Submodular Data Selection for Continual Pre-Training of Large Language Models
Zhenghao Zhao, Gaowen Liu, Zhiling Lan +1
Data selection is already a central bottleneck in large-language-model training, where web-scale corpora are noisy and token budgets are finite. In continual pre-training (CPT), it…
SMART: A Surrogate Model for Predicting Application Runtime in Dragonfly Systems
Xin Wang, Pietro Lodi Rizzini, Sourav Medya +1
The Dragonfly network, with its high-radix and low-diameter structure, is a leading interconnect in high-performance computing. A major challenge is workload interference on shared…
Ranking Before Serving: Low-Latency LLM Serving via Pairwise Learning-to-Rank
Yiheng Tao, Yihe Zhang, Matthew Dearing +4
Efficient scheduling of large language model (LLM) inference tasks is critical for achieving low latency and high throughput, a challenge that is becoming increasingly acute with t…
SST: Multi-Scale Hybrid Mamba-Transformer Experts for Time Series Forecasting
Xiongxiao Xu, Canyu Chen, Yueqing Liang +4
Time series forecasting has made significant advances, including with Transformer-based models. The attention mechanism in Transformer effectively captures temporal dependencies by…