From the 1 of 7 linked papers with an AI index.
7 papers
Scaling the Horizon, Not the Parameters: Reaching Trillion-Parameter Performance with a 35B Agent
Lei Bai, Zongsheng Cao, Yang Chen +50
The paper introduces Agents-A1, a 35B mixture-of-experts agent model that attains trillion-parameter-level performance by extending the length of reasoning horizons and integrating…
A Scalable Multi-LLM Collaboration System with Retrieval-based Selection and Exploration-Exploitation-Driven Enhancement
Shengji Tang, Jianjian Cao, Weihao Lin +7
Existing multi-LLM collaboration systems often encounter scalability challenges when integrating new LLMs and tasks, leading to suboptimal performance. To address this, we propose…
Beyond Gemini-3-Pro: Revisiting LLM Routing and Aggregation at Scale
Shengji Tang, Weihao Lin, Peng Ye +9
Large Language Models (LLMs) have rapidly advanced, with Gemini-3-Pro setting a new performance milestone. In this work, we explore collective intelligence as an alternative to mon…
Wisdom of the Crowd: Reinforcement Learning from Coevolutionary Collective Feedback
Wenzhen Yuan, Shengji Tang, Weihao Lin +8
Reinforcement learning (RL) has significantly enhanced the reasoning capabilities of large language models (LLMs), but its reliance on expensive human-labeled data or complex rewar…
Multi-Level Decoupled Relational Distillation for Heterogeneous Architectures
Yaoxin Yang, Peng Ye, Weihao Lin +4
Heterogeneous distillation is an effective way to transfer knowledge from cross-architecture teacher models to student models. However, existing heterogeneous distillation methods…
S2HPruner: Soft-to-Hard Distillation Bridges the Discretization Gap in Pruning
Weihao Lin, Shengji Tang, Chong Yu +2
Recently, differentiable mask pruning methods optimize the continuous relaxation architecture (soft network) as the proxy of the pruned discrete network (hard network) for superior…