Showing 2025Show all
2 papers · 1 filter
cs.LG2025
SQS: Bayesian DNN Compression through Sparse Quantized Sub-distributions
Ziyi Wang, Nan Jiang, Guang Lin +1
Compressing large-scale neural networks is essential for deploying models on resource-constrained devices. Most existing methods adopt weight pruning or low-bit quantization indivi…
cs.LG2025
LLM Safety Alignment is Divergence Estimation in Disguise
Rajdeep Haldar, Ziyi Wang, Qifan Song +2
We present a theoretical framework showing that popular LLM alignment methods, including RLHF and its variants, can be understood as divergence estimators between aligned (safe or…