11 citations · 15 across the 5 of their papers we have counts for
5 papers
Two to Tango: Coupled Task-Reference Selection for Safe LLM Fine-tuning
Xinrui Chen, Jianhao Zhang, Ou Wu +1
Fine-tuning safety aligned large language models (LLMs) on downstream data improves adaptation but may erode learned safety behavior. Existing methods use fixed safety examples, gl…
Skywork-R1V3 Technical Report
Wei Shen, Jiangbo Pei, Yi Peng +8
We introduce Skywork-R1V3, an advanced, open-source vision-language model (VLM) that pioneers a new approach to visual reasoning. Its key innovation lies in effectively transferrin…
Skywork R1V2: Multimodal Hybrid Reinforcement Learning for Reasoning
Peiyu Wang, Yichen Wei, Yi Peng +10
We present Skywork R1V2, a next-generation multimodal reasoning model and a major leap forward from its predecessor, Skywork R1V. At its core, R1V2 introduces a hybrid reinforcemen…
Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
Tianwen Wei, Bo Zhu, Liang Zhao +13
In this technical report, we introduce the training methodologies implemented in the development of Skywork-MoE, a high-performance mixture-of-experts (MoE) large language model (L…
Skywork: A More Open Bilingual Foundation Model
Tianwen Wei, Liang Zhao, Lichang Zhang +27
In this technical report, we present Skywork-13B, a family of large language models (LLMs) trained on a corpus of over 3.2 trillion tokens drawn from both English and Chinese texts…