5 citations · 6 across the 7 of their papers we have counts for
1 paper · 1 filter
Abhishek Malvankar, Lionel Villard, Mohammed Abdi +6
As Large Language Models (LLMs) scale to handle massive concurrent traffic, optimizing the infrastructure required for inference has become a primary challenge. To manage the high…