28 citations · 63 across the 31 of their papers we have counts for
5 papers · 1 filter
Teacher-Guided Tool Learning for Small Language Models via Bidirectional KL Constraints
Haoxuan Gao, Qin-Wen Luo, Xiang Chen +5
External tools can extend the capabilities of small language models (SLMs), enabling their deployment in resource constrained environments. However, their limited capabilities make…
Asymmetric On-Policy Distillation: Bridging Exploitation and Imitation at the Token Level
Nan Jia, Haojin Yang, Xing Ma +6
On-policy distillation (OPD) trains a student on its own trajectories with token-level teacher feedback and often outperforms off-policy distillation and standard reinforcement lea…
Breaking the Reasoning Horizon in Entity Alignment Foundation Models
Yuanning Cui, Zequn Sun, Wei Hu +2
Entity alignment (EA) is critical for knowledge graph (KG) fusion. Existing EA models lack transferability and are incapable of aligning unseen KGs without retraining. While using…
WavefrontDiffusion: Dynamic Decoding Schedule for Improved Reasoning
Haojin Yang, Rui Hu, Zequn Sun +3
Diffusion Language Models (DLMs) have shown strong potential for text generation and are becoming a competitive alternative to autoregressive models. The denoising strategy plays a…
Large-scale Entity Alignment via Knowledge Graph Merging, Partitioning and Embedding
Kexuan Xin, Zequn Sun, Wen Hua +3
Entity alignment is a crucial task in knowledge graph fusion. However, most entity alignment approaches have the scalability problem. Recent methods address this issue by dividing…