40 citations · 47 across the 12 of their papers we have counts for
Showing 2024 · cs.AIShow all
2 papers · 2 filters
cs.AI2024
AdaEAGLE: Optimizing Speculative Decoding via Explicit Modeling of Adaptive Draft Structures
Situo Zhang, Hankun Wang, Da Ma +4
Speculative Decoding (SD) is a popular lossless technique for accelerating the inference of Large Language Models (LLMs). We show that the decoding speed of SD frameworks with stat…
cs.AI2024
Towards Reliable and Empathetic Depression-Diagnosis-Oriented Chats
Kunyao Lan, Cong Ming, Binwei Yao +2
Chatbots can serve as a viable tool for preliminary depression diagnosis via interactive conversations with potential patients. Nevertheless, the blend of task-oriented and chit-ch…