3 papers
cs.CL2025
LADM: Long-context Training Data Selection with Attention-based Dependency Measurement for LLMs
Jianghao Chen, Junhong Wu, Yangyifan Xu +1
Long-context modeling has drawn more and more attention in the area of Large Language Models (LLMs). Continual training with long-context data becomes the de-facto method to equip…
cs.CL2025
SimulPL: Aligning Human Preferences in Simultaneous Machine Translation
Donglei Yu, Yang Zhao, Jie Zhu +3
Simultaneous Machine Translation (SiMT) generates translations while receiving streaming source inputs. This requires the SiMT model to learn a read/write policy, deciding when to…
cs.CL2024
Hit the Sweet Spot! Span-Level Ensemble for Large Language Models
Yangyifan Xu, Jianghao Chen, Junhong Wu +1
Ensembling various LLMs to unlock their complementary potential and leverage their individual strengths is highly valuable. Previous studies typically focus on two main paradigms:…