Showing 2024Show all
2 papers · 1 filter
cs.AR2024
FinGraV: Methodology for Fine-Grain GPU Power Visibility and Insights
Varsha Singhania, Shaizeen Aga, Mohamed Assem Ibrahim
Ubiquity of AI makes optimizing GPU power a priority as large GPU-based clusters are often employed to train and serve AI models. An important first step in optimizing GPU power co…
cs.AR2024
Balanced Data Placement for GEMV Acceleration with Processing-In-Memory
Mohamed Assem Ibrahim, Mahzabeen Islam, Shaizeen Aga
With unprecedented demand for generative AI (GenAI) inference, acceleration of primitives that dominate GenAI such as general matrix-vector multiplication (GEMV) is receiving consi…