9 papers
DominoTree: Conditional Tree-Structured Drafting with Domino for Speculative Decoding
Saw S. Lin, Jyh-Shing Roger Jang
Speculative decoding accelerates LLM inference by drafting tokens and verifying them in parallel. Block-diffusion drafters such as DFlash model only per-position marginals, and tre…
Only Ask What You Don't Know: Grounded Delta Planning for Efficient Multi-step RAG
Wei-Chieh Chou, Xuanjun Chen, Jian-Ren Lin +3
Multi-hop question answering remains challenging for Retrieval-Augmented Generation (RAG) because existing approaches either propagate errors across iterative retrieval rounds or o…
Mitigating Proxy-to-Wild Domain Gap in Deepfake Speech
Xuanjun Chen, Yun-Shing Wu, Wei-Chung Lu +4
Recent neural audio codec-based speech generation (CodecFake) produces highly realistic audio, posing a challenge to existing deepfake countermeasure models. While using codec resy…
Equilibrium Residuals Expose Three Regimes of Matrix-Game Strategic Reasoning in Language Models
Wenhua Nie, Binhan Luo, Zijie Meng +2
Large language models can score well on named game-theory benchmarks while failing on the same strategic computation once semantic cues are removed. We show this gap with procedura…
Identified-Set Geometry of Distributional Model Extraction under Top- Censored API Access
Wenhua Nie, ZiCheng Zhu, Jianan Wu +3
Modern LLM APIs often reveal only top- logit scores and censor the remaining vocabulary. We study the per-position distribution-recovery limits of this access model. For censori…
Future Validity is the Missing Statistic: From Impossibility to -Estimation for Grammar-Faithful Speculative Decoding
Wenhua Nie, Zijie Meng, Kun Zou +5
Grammar-constrained generation is often combined with local vocabulary masking and speculative decoding, but the resulting sampling law is not the grammar-conditional distribution…