Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
Full Attention Strikes Back: Transferring Full Attention into Sparse within Hundred Training Steps
Yanke Zhou, Yiduo Li, Hanlin Tang +6
Long-context inference in large language models is bottlenecked by the quadratic cost of full attention. Existing efficient alternatives often rely either on native sparse training…
cs.CL2023
Exploring the Factual Consistency in Dialogue Comprehension of Large Language Models
Shuaijie She, Shujian Huang, Xingyun Wang +2
LLMs (Large Language Models) usually interact with users in the form of dialogue and generate responses following their instructions, which naturally require dialogue comprehension…