8 citations · 11 across the 17 of their papers we have counts for
5 papers · 1 filter
47B Mixture-of-Experts Beats 671B Dense Models on Chinese Medical Examinations
Chiung-Yi Tseng, Danyang Zhang, Tianyang Wang +8
The rapid advancement of large language models(LLMs) has prompted significant interest in their potential applications in medical domains. This paper presents a comprehensive bench…
Towards Alignment-Centric Paradigm: A Survey of Instruction Tuning in Large Language Models
Xudong Han, Junjie Yang, Tianyang Wang +4
Instruction tuning is a pivotal technique for aligning large language models (LLMs) with human intentions, safety constraints, and domain-specific requirements. This survey provide…
Is GPT-OSS Good? A Comprehensive Evaluation of OpenAI's Latest Open Source Models
Ziqian Bi, Keyu Chen, Chiung-Yi Tseng +9
In August 2025, OpenAI released GPT-OSS models, its first open weight large language models since GPT-2 in 2019, comprising two mixture of experts architectures with 120B and 20B p…
Exploring Efficiency Frontiers of Thinking Budget in Medical Reasoning: Scaling Laws between Computational Resources and Reasoning Quality
Ziqian Bi, Lu Chen, Junhao Song +15
This study presents the first comprehensive evaluation of thinking budget mechanisms in medical reasoning tasks, revealing fundamental scaling laws between computational resources…
Feature Alignment and Representation Transfer in Knowledge Distillation for Large Language Models
Junjie Yang, Junhao Song, Xudong Han +9
Knowledge distillation (KD) is a technique for transferring knowledge from complex teacher models to simpler student models, significantly enhancing model efficiency and accuracy.…