Showing cs.CLShow all
3 papers · 1 filter
cs.CL2026
Nucleus Speculative Decoding: Plausibility-Aware Verification Beyond Exact Distribution
Shuhao Li, Fanghua Ye, Wanyu Lin +2
Speculative decoding (SD) accelerates autoregressive generation by letting a lightweight draft model propose tokens that a target model verifies in parallel. However, its standard…
cs.CL2025
SkipGPT: Dynamic Layer Pruning Reinvented with Token Awareness and Module Decoupling
Anhao Zhao, Fanghua Ye, Yingqi Fan +4
Large language models (LLMs) achieve remarkable performance across tasks but incur substantial computational costs due to their deep, multi-layered architectures. Layer pruning has…
cs.CL2024
Unveiling In-Context Learning: A Coordinate System to Understand Its Working Mechanism
Anhao Zhao, Fanghua Ye, Jinlan Fu +1
Large language models (LLMs) exhibit remarkable in-context learning (ICL) capabilities. However, the underlying working mechanism of ICL remains poorly understood. Recent research…