14 citations · 14 across the 2 of their papers we have counts for
2 papers
cs.AR2026
FLINT: Efficiently Leveraging High Bandwidth Flash for Capacity-Scalable LLM Inference Acceleration
Geraldo F. Oliveira, Arash Tavakkol, Xiangyu Zhu +10
LLM inference is increasingly constrained by accelerator memory capacity rather than compute throughput. This constraint is especially acute in single-accelerator and small-node in…
cs.CV2023★ 14 cited
Hierarchical Training of Deep Neural Networks Using Early Exiting
Yamin Sepehri, Pedram Pad, Ahmet Caner Yüzügüler +2
Deep neural networks provide state-of-the-art accuracy for vision tasks but they require significant resources for training. Thus, they are trained on cloud servers far from the ed…