Compressed code: the hidden effects of quantization and distillation on programming tokens

Viacheslav Siniaev, Iaroslav Chelombitko, Aleksey Komissarov

Large Language Models (LLMs) have demonstrated exceptional code generation capabilities, yet their token-level mechanisms remain underexplored, particularly in compressed models. T…