8 citations · 18 across the 25 of their papers we have counts for
7 papers · 1 filter
CORAL-KV: Compact Cross-Layer Prediction and Residual Coding for Autoregressive Video KV Caches
Albert Ge, Akash Haridas, Utkarsh Saxena +5
Autoregressive video diffusion models maintain a growing attention key-value (KV) cache, making memory a key bottleneck for long video generation. Recently, clustering-based quanti…
dMX: Differentiable Mixed-Precision Assignment for Low-Precision Floating-Point Formats
Giuseppe Franco, Ian Colbert, Pablo Monteagudo-Lago +2
Quantizing large language models (LLMs) to low-precision floating-point representations is central to efficient deployment, yet applying a single bit-width uniformly across all lay…
DataGuard: Guaranteeing Private Training in Systolic-array Based Accelerators
Pawan Kumar Sanjaya, Christina Giannoula, Nikhil Shreekumar +6
Differential privacy (DP) and federated learning (FL) have emerged as important privacy-preserving approaches when using sensitive data to train machine learning (ML) models. FL en…
Signed Symmetric Quantization for Few-Bit Integers
Ian Colbert, Eashan Dash, Pablo Monteagudo-Lago +5
The signed integer alphabet contains one more negative representable value than positive. Yet, by convention, the standard symmetric integer quantizer fixes its scale to be strictl…
Optimal Post-Training Quantization Scales and Where to Find Them
Juan Amboage, Pablo Monteagudo-Lago, Ian Colbert +2
Post-training quantization (PTQ) compresses large language models by mapping weights to low-bit representations. While much work has focused on how weights are rounded onto the qua…
GPU Acceleration of Sparse Fully Homomorphic Encrypted DNNs
Lara D'Agata, Carlos Agulló-Domingo, Óscar Vera-López +7
Fully homomorphic encryption (FHE) has recently attracted significant attention as both a cryptographic primitive and a systems challenge. Given the latest advances in accelerated…
Pushing the Limits of Block Rotations in Post-Training Quantization
Sai Sanjeet, Ian Colbert, Pablo Monteagudo-Lago +3
Recent post-training quantization (PTQ) methods have adopted block rotations to diffuse outliers prior to rounding. While this reduces the overhead of online full-vector rotations,…