activity
20232026
most citedOrca 2: Teaching Small Language Models How to Reason

32 citations · 32 across the 6 of their papers we have counts for

collaborators

8 papers

cs.CL2026

IQuest-Q1: Advancing Foundation Capabilities for Agentic CLI Systems

A. Jian Yang, An Huang, Bo Dan +173

We present IQuest-Q1, a sparse Mixture-of-Experts (MoE) agentic foundation model with 320B total parameters (15B activated). IQuest-Q1 is developed through a three-stage process: (…

cs.CL2026

ClawGym II: Exploring Black-Box RL on Agent Harness

Huatong Song, Fei Bai, Ming Yang +17

Agent harnesses have substantially improved performance on long-horizon tasks by coordinating agent interactions with the environment. However, reinforcement learning through compl…

cs.LG2025

Tree Training: Accelerating Agentic LLMs Training via Shared Prefix Reuse

Jinghui Wang, Shaojie Wang, Yinghan Cui +9

Agentic large language model (LLM) training often involves multi-turn interaction trajectories that branch into multiple execution paths due to concurrent tool use, think-mode, sub…

cs.CL2025

KAT-Coder Technical Report

Zizheng Zhan, Ken Deng, Jinghui Wang +37

Recent advances in large language models (LLMs) have enabled progress in agentic coding, where models autonomously reason, plan, and act within interactive software development wor…

cs.LG2025

SeamlessFlow: A Trainer Agent Isolation RL Framework Achieving Bubble-Free Pipelines via Tag Scheduling

Jinghui Wang, Shaojie Wang, Yinghan Cui +24

We introduce SeamlessFlow, a server based reinforcement learning (RL) framework that addresses two core challenges in industrial scale RL: (1) decoupling RL training from the compl…

cs.CL2025

KAT-V1: Kwai-AutoThink Technical Report

Zizheng Zhan, Ken Deng, Huaixi Tang +27

We present Kwaipilot-AutoThink (KAT), an open-source 40B large language model developed to address the overthinking problem in reasoning-intensive tasks, where an automatic thinkin…

cs.IR2024

MultiBalance: Multi-Objective Gradient Balancing in Industrial-Scale Multi-Task Recommendation System

Yun He, Xuxing Chen, Jiayi Xu +11

In industrial recommendation systems, multi-task learning (learning multiple tasks simultaneously on a single model) is a predominant approach to save training/serving resources an…

cs.AI2023★ 32 cited

Orca 2: Teaching Small Language Models How to Reason

Arindam Mitra, Luciano Del Corro, Shweti Mahajan +12

Orca 1 learns from rich signals, such as explanation traces, allowing it to outperform conventional instruction-tuned models on benchmarks like BigBench Hard and AGIEval. In Orca 2…