3 papers
cs.LG2026
Frozen Factor or Spectral Band? Disentangling Two Choices in Low-Rank LoRA
Adnan Slimane Ali, Ayoub Belfatmi, David Ngwe Pouth
Spectral variants of low-rank adaptation (LoRA) choose both a subspace and which factor to freeze. We separate these choices by freezing the input factor A or output factor B on th…
cs.AI2026
Calibrated e-CUSUM Decoding for Quantized Reasoning Models: Why Token Log-Probability Is the Wrong Observable for Decoding Monitors
El Hassane Ettifouri, Ayoub Belfatmi, Mahaman Sanoussi Yahaya Alassan +1
Low-bit quantization makes small reasoning models inexpensive to deploy but can degrade their chains of thought. This motivates decoder-side monitors that intervene when generation…
cs.AI2026
CUSUM-Shaped Inference-Time Monitoring and Targeted Re-Decoding for Quantized Small Language Model Reasoning
El Hassane Ettifouri, Ayoub Belfatmi, Mahaman Sanoussi Yahaya Alassan +1
Quantized small reasoning models can enter repetitive or otherwise unproductive trajectories, yet standard decoding does not adapt to the trajectory as it unfolds. We study MGT-B,…