3 citations · 4 across the 3 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.CL2024
Multi-Bin Batching for Increasing LLM Inference Throughput
Ozgur Guldogan, Jackson Kunde, Kangwook Lee +1
As large language models (LLMs) grow in popularity for their diverse capabilities, improving the efficiency of their inference systems has become increasingly critical. Batching LL…
stat.ML2024★ 3 cited
Long-Term Fairness in Sequential Multi-Agent Selection with Positive Reinforcement
Bhagyashree Puranik, Ozgur Guldogan, Upamanyu Madhow +1
While much of the rapidly growing literature on fair decision-making focuses on metrics for one-shot decisions, recent work has raised the intriguing possibility of designing seque…