4 papers · 1 filter
Generalization Is Stability, Not Accuracy: Multi-Axis Evaluation of LLMs
Nagham Omar, Mahmoud Jabarin, Maya Rozenshtein +3
Generalization in large language models (LLMs) is the ability to produce consistent and semantically stable outputs when the same input is expressed in different ways. Existing wor…
You Had One Job: Per-Task Quantization Using LLMs' Hidden Representations
Amit LeVi, Raz Lapid, Rom Himelstein +3
Many LLM applications require only narrow capabilities, yet standard post-training quantization (PTQ) methods allocate precision without considering the target task. This can waste…
Silenced Biases: The Dark Side LLMs Learned to Refuse
Rom Himelstein, Amit LeVi, Brit Youngmann +2
Safety-aligned large language models (LLMs) are becoming increasingly widespread, especially in sensitive applications where fairness is essential and biased outputs can cause sign…
Silent Tokens, Loud Effects: Padding in LLMs
Rom Himelstein, Amit LeVi, Yonatan Belinkov +1
Padding tokens are widely used in large language models (LLMs) to equalize sequence lengths during batched inference. While they should be fully masked, implementation errors can c…