4 citations · 4 across the 3 of their papers we have counts for
3 papers
cs.AI2024
Skywork-Math: Data Scaling Laws for Mathematical Reasoning in Large Language Models -- The Story Goes On
Liang Zeng, Liangjun Zhong, Liang Zhao +9
In this paper, we investigate the underlying factors that potentially enhance the mathematical reasoning capabilities of large language models (LLMs). We argue that the data scalin…
cs.CL2024★ 4 cited
Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
Tianwen Wei, Bo Zhu, Liang Zhao +13
In this technical report, we introduce the training methodologies implemented in the development of Skywork-MoE, a high-performance mixture-of-experts (MoE) large language model (L…
cs.DB2023
Comparative Evaluation of Data Decoupling Techniques for Federated Machine Learning with Database as a Service
Muhammad Jahanzeb Khan, Rui Hu, Mohammad Sadoghi +1
Federated Learning (FL) is a machine learning approach that allows multiple clients to collaboratively learn a shared model without sharing raw data. However, current FL systems pr…