4 papers
TopoQuant: Topological Framework to Characterize Behavioral Shifts in Quantized Large Language Models
Baha Rababah, Shahzeb Qamar, Lorenz Sparrenberg +4
Post-training quantization (PTQ) reduces the com putational cost of large language models (LLMs), but it can introduce internal structural and behavioral changes that are not captu…
Accuracy is Not Enough: A Divergence-Based Approach to Evaluate Fidelity Loss in Quantized LLMs
Shahzeb Qamar, Lorenz Sparrenberg, Christian Bauckhage +5
Deployment of Large Language Models (LLMs) on memory-constrained edge devices relies heavily on aggressive post-training quantization. However, evaluating these models is largely b…
The Illusion of Equivalency: Statistical Characterization of Quantization Effects in LLMs
Baha Rababah, Shahzeb Qamar, Lorenz Sparrenberg +4
Post-Training Quantization has become widely used to compress large language models to make them deployable on resource-constrained devices. However, the evaluation of quantization…
ArithmAttack: Evaluating Robustness of LLMs to Noisy Context in Math Problem Solving
Zain Ul Abedin, Shahzeb Qamar, Lucie Flek +1
While Large Language Models (LLMs) have shown impressive capabilities in math problem-solving tasks, their robustness to noisy inputs is not well-studied. We propose ArithmAttack t…