3 papers
cs.MA2026
LLM Multi-Agent Systems: Challenges and Open Problems
Shanshan Han, Qifan Zhang, Weizhao Jin +1
This paper explores multi-agent systems and identify challenges that remain inadequately addressed. By leveraging the diverse capabilities and roles of individual agents, multi-age…
cs.LG2025
OAT-Rephrase: Optimization-Aware Training Data Rephrasing for Zeroth-Order LLM Fine-Tuning
Jikai Long, Zijian Hu, Xiaodong Yu +2
Fine-tuning large language models (LLMs) using zeroth-order optimization (ZO) offers a memory-efficient alternative to gradient-based methods but suffers from slower convergence an…
cs.CL2025
Fox-1: Open Small Language Model for Cloud and Edge
Zijian Hu, Jipeng Zhang, Rui Pan +9
We present Fox-1, a series of small language models (SLMs) consisting of Fox-1-1.6B and Fox-1-1.6B-Instruct-v0.1. These models are pre-trained on 3 trillion tokens of web-scraped d…