Showing cs.CLShow all
2 papers · 1 filter
cs.CL2025
Efficient and Asymptotically Unbiased Constrained Decoding for Large Language Models
Haotian Ye, Himanshu Jain, Chong You +4
In real-world applications of large language models, outputs are often required to be confined: selecting items from predefined product or document sets, generating phrases that co…
cs.CL2024
Exploring and Improving Drafts in Blockwise Parallel Decoding
Taehyeon Kim, Ananda Theertha Suresh, Kishore Papineni +3
Despite the remarkable strides made by autoregressive language models, their potential is often hampered by the slow inference speeds inherent in sequential token generation. Block…