2 papers
cs.LG2026
Efficient VQ-QAT and Mixed Vector/Linear quantized Neural Networks
Terry Gou, Puneet Gupta
In this work, we developed and tested 3 techniques for vector quantization (VQ) based model weight compression. To mitigate codebook collapse and enable end-to-end training, we ado…
cs.AR2026
MXFormer: A Microscaling Floating-Point Charge-Trap Transistor Compute-in-Memory Transformer Accelerator
George Karfakis, Samyak Chakrabarty, Vinod Kurian Jacob +4
The proliferation of Transformer models is often constrained by the significant computational and memory bandwidth demands of deployment. To address this, we present MXFormer, a no…