62 citations · 285 across the 35 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.CL2024
TriSum: Learning Summarization Ability from Large Language Models with Structured Rationale
Pengcheng Jiang, Cao Xiao, Zifeng Wang +3
The advent of large language models (LLMs) has significantly advanced natural language processing tasks like text summarization. However, their large size and computational demands…
cs.LG2024
Bifurcated Attention: Accelerating Massively Parallel Decoding with Shared Prefixes in LLMs
Ben Athiwaratkun, Sujan Kumar Gonugondla, Sanjay Krishna Gouda +10
This study introduces bifurcated attention, a method designed to enhance language model inference in shared-context batch decoding scenarios. Our approach addresses the challenge o…