10 citations · 11 across the 13 of their papers we have counts for
1 paper · 1 filter
Asad Aali, Adney Cardoza, Melissa Capo
Efficient inference of LLMs remains a crucial challenge, with two main phases: a compute-intensive prompt computation and a memory-intensive token generation. Despite existing batc…