4 papers
Immersion in the GitHub Universe: Scaling Coding Agents to Mastery
Jiale Zhao, Guoxin Chen, Fanzhe Meng +11
Achieving mastery in real world software engineering tasks is fundamentally bottlenecked by the scarcity of large scale, high quality training data. Scaling such data has been limi…
Open-Sora 2.0: Training a Commercial-Level Video Generation Model in $200k
Zangwei Zheng, Xiangyu Peng, Yuxuan Lou +30
Video generation models have achieved remarkable progress in the past year. The quality of AI video continues to improve, but at the cost of larger model size, increased data quant…
Federated Learning Clients Clustering with Adaptation to Data Drifts
Minghao Li, Dmitrii Avdiukhin, Rana Shahout +3
Federated Learning (FL) trains deep models across edge devices without centralizing raw data, preserving user privacy. However, client heterogeneity slows down convergence and limi…
CCQ: Convolutional Code for Extreme Low-bit Quantization in LLMs
Zhaojing Zhou, Xunchao Li, Minghao Li +8
The rapid scaling of Large Language Models (LLMs) elevates inference costs and compounds substantial deployment barriers. While quantization to 8 or 4 bits mitigates this, sub-3-bi…