2 papers
cs.LG2024
Characterizing the Accuracy -- Efficiency Trade-off of Low-rank Decomposition in Language Models
Chakshu Moar, Faraz Tahmasebi, Michael Pellauer +1
Recent large language models (LLMs) employ billions of parameters to enable broad problem-solving capabilities. Such language models also tend to be memory-bound because of the dom…
cs.AR2024
PipeOrgan: Efficient Inter-operation Pipelining with Flexible Spatial Organization and Interconnects
Raveesh Garg, Hyoukjun Kwon, Eric Qin +3
Because of the recent trends in Deep Neural Networks (DNN) models being memory-bound, inter-operator pipelining for DNN accelerators is emerging as a promising optimization. Inter-…