3 citations · 4 across the 2 of their papers we have counts for
2 papers
cs.LG2024★ 1 cited
Kraken: Inherently Parallel Transformers For Efficient Multi-Device Inference
Rohan Baskar Prabhakar, Hengrui Zhang, David Wentzlaff
Large Transformer networks are increasingly used in settings where low inference latency can improve the end-user experience and enable new applications. However, autoregressive in…
cs.AR2023★ 3 cited
A Hardware Evaluation Framework for Large Language Model Inference
Hengrui Zhang, August Ning, Rohan Prabhakar +1
The past year has witnessed the increasing popularity of Large Language Models (LLMs). Their unprecedented scale and associated high hardware cost have impeded their broader adopti…