9 citations · 10 across the 7 of their papers we have counts for
3 papers · 1 filter
Breaking the 1.58-bit Barrier for Ternary LLMs
Evangelos Georganas, Alexander Heinecke, Pradeep Dubey
Ternary Large Language Models (LLM) store every weight as one of three symbols , so the cost of a ternary model is conventionally referenced to the information-theoret…
Xe-Forge: Multi-Stage LLM-Powered Kernel Optimization for Intel GPU
Marcin Spoczynski, Daniel Fleischer, Moshe Berchansky +5
Porting deep learning algorithms to new hardware accelerators requires developers to repeatedly apply the same low-level optimizations -- quantization, memory access coalescing, ti…
Space Filling Curves is All You Need: Communication-Avoiding Matrix Multiplication Made Simple
Evangelos Georganas, Alexander Heinecke, Pradeep Dubey
General Matrix Multiplication (GEMM) is the cornerstone of HPC workloads and Deep Learning. State-of-the-art (SOTA) vendor libraries tune tensor layouts, parallelization schemes an…