23 citations · 26 across the 16 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2025
3-Model Speculative Decoding
Sanghyun Byun, Mohanad Odema, Jung Ick Guack +3
Speculative Decoding (SD) accelerates inference in large language models by using a smaller draft model to propose tokens, which are then verified by a larger target model. However…
cs.CL2025
APCE: Adaptive Progressive Context Expansion for Long Context Processing
Baisub Lee, Sanghyun Byun, Mohanad Odema +3
Deploying useful Long-Context Transformer Models (LCTMs) requires addressing two key challenges: (1) A growing memory footprint due to quadratic self-attention and linear KV-cache…