activity
20222026
most citedShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference

1 citations · 2 across the 14 of their papers we have counts for

collaborators
Showing 2025Show all

2 papers · 1 filter

cs.AI2025

Generalized Parallel Scaling with Interdependent Generations

Harry Dong, David Brandfonbrener, Eryk Helenowski +5

Parallel LLM inference scaling involves sampling a set of responses for a single input prompt. However, these parallel responses tend to be generated independently from e…

cs.CL2025

Scalable LLM Reasoning Acceleration with Low-rank Distillation

Harry Dong, Bilge Acun, Beidi Chen +1

Due to long generations, large language model (LLM) math reasoning demands significant computational resources and time. While many existing efficient inference methods have been d…