11 citations · 15 across the 5 of their papers we have counts for
6 papers
UAF: A Unified Audio Front-end LLM for Full-Duplex Speech Interaction
Yadong Li, Guoxin Wu, Haiping Hou +1
Full-duplex speech interaction, as the most natural and intuitive mode of human communication, is driving artificial intelligence toward more human-like conversational systems. Tra…
LEAPS: An LLM-Empowered Adaptive Plugin in Taobao AI Search
Lei Wang, Jinhang Wu, Zhibin Wang +1
The rapid rise of large language models has shifted user search behavior from discrete keywords to natural-language, multi-constraint queries--a shift existing e-commerce search ar…
Teaching Language Models to Evolve with Users: Dynamic Profile Modeling for Personalized Alignment
Weixiang Zhao, Xingyu Sui, Yulin Hu +6
Personalized alignment is essential for enabling large language models (LLMs) to engage effectively in user-centric dialogue. While recent prompt-based and offline optimization met…
Optimal Brain Iterative Merging: Mitigating Interference in LLM Merging
Zhixiang Wang, Zhenyu Mao, Yixuan Qiao +2
Large Language Models (LLMs) have demonstrated impressive capabilities, but their high computational costs pose challenges for customization. Model merging offers a cost-effective…
Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
Tianwen Wei, Bo Zhu, Liang Zhao +13
In this technical report, we introduce the training methodologies implemented in the development of Skywork-MoE, a high-performance mixture-of-experts (MoE) large language model (L…
Skywork: A More Open Bilingual Foundation Model
Tianwen Wei, Liang Zhao, Lichang Zhang +27
In this technical report, we present Skywork-13B, a family of large language models (LLMs) trained on a corpus of over 3.2 trillion tokens drawn from both English and Chinese texts…