2 papers
cs.CL2024
Endor: Hardware-Friendly Sparse Format for Offloaded LLM Inference
Donghyeon Joo, Ramyad Hadidi, Soheil Feizi +1
The increasing size of large language models (LLMs) challenges their usage on resource-constrained platforms. For example, memory on modern GPUs is insufficient to hold LLMs that a…
cs.LG2024
Network architecture search of X-ray based scientific applications
Adarsha Balaji, Ramyad Hadidi, Gregory Kollmer +2
X-ray and electron diffraction-based microscopy use bragg peak detection and ptychography to perform 3-D imaging at an atomic resolution. Typically, these techniques are implemente…