activity
20242026
most citedInstruction Pre-Training: Language Models are Supervised Multitask Learners

4 citations · 5 across the 17 of their papers we have counts for

collaborators
Showing 2026Show all

12 papers · 1 filter

cs.CL2026

Agensh: Scaling Organizational Intelligence to 1,024 Agents

Zhihao Zhan, Ting Song, Li Dong +4

A multi-agent system can reduce latency on complex tasks by executing work concurrently. Several pioneering harness frameworks support multi-agent systems. However, the scalability…

cs.SD2026

VibeVoice-ASR-BitNet Technical Report

Songchen Xu, Ting Song, Shaohan Huang +10

We present VibeVoice-ASR-BitNet, a compressed variant of VibeVoice-ASR optimized for real-time inference on edge CPUs. We apply heterogeneous quantization tailored to the computati…

cs.CL2026

BitNet Text Embeddings

Zhen Li, Xin Huang, Liang Wang +8

LLM-based text embedders have substantially improved retrieval and semantic representation quality, but their deployment remains costly: large backbone models slow down embedding i…

cs.LG2026

LLM-as-a-Coach: Experiential Learning for Non-Verifiable Tasks

Tianzhu Ye, Li Dong, Guanheng Chen +4

Reinforcement learning (RL) on open-ended tasks compresses an LLM's rubric-based evaluation into a scalar reward, discarding rich textual feedback and conflating responses with dis…

cs.LG2026

Group-Graph Policy Optimization for Long-Horizon Agentic Reinforcement Learning

Yunan Wang, Minghui Song, Zihan Zhang +6

Group-based Reinforcement Learning (RL) has significantly enhanced Large Language Models (LLMs) in agentic scenarios. To achieve finer-grained policy updates, recent agentic RL fra…

cs.CL2026

Universal YOCO for Efficient Depth Scaling

Yutao Sun, Li Dong, Tianzhu Ye +3

The rise of test-time scaling has remarkably boosted the reasoning and agentic proficiency of Large Language Models (LLMs). Yet, standard Transformers struggle to scale inference-t…

cs.CL2026

On-Policy Context Distillation for Language Models

Tianzhu Ye, Li Dong, Xun Wu +2

Context distillation enables language models to internalize in-context knowledge into their parameters. In our work, we propose On-Policy Context Distillation (OPCD), a framework t…

cs.LG2026

SlideSparse: Fast and Flexible (2N-2):2N Structured Sparsity

Hanyong Shao, Yingbo Hao, Ting Song +10

NVIDIA's 2:4 Sparse Tensor Cores deliver 2x throughput but demand strict 50% pruning -- a ratio that collapses LLM reasoning accuracy (Qwen3: 54% to 15%). Milder patter…

cs.CL2026

Sparse-BitNet: 1.58-bit LLMs are Naturally Friendly to Semi-Structured Sparsity

Di Zhang, Xun Wu, Shaohan Huang +9

Semi-structured N:M sparsity and low-bit quantization (e.g., 1.58-bit BitNet) are two promising approaches for improving the efficiency of large language models (LLMs), yet they ha…

cs.CL2026

Online Experiential Learning for Language Models

Tianzhu Ye, Li Dong, Qingxiu Dong +3

The prevailing paradigm for improving large language models relies on offline training with human annotations or simulated environments, leaving the rich experience accumulated dur…

cs.SD2026

VIBEVOICE-ASR Technical Report

Zhiliang Peng, Jianwei Yu, Yaoyao Chang +21

This report presents VibeVoice-ASR, a general-purpose speech understanding framework built upon VibeVoice, designed to address the persistent challenges of context fragmentation an…

cs.CL2026

Computer Environments Elicit General Agentic Intelligence in LLMs

Daixuan Cheng, Shaohan Huang, Yuxian Gu +6

Agentic intelligence in large language models (LLMs) requires not only model intrinsic capabilities but also interactions with external environments. Equipping LLMs with computers…