Showing stat.MLShow all
2 papers · 1 filter
stat.ML2026
Multi-Scale Dequant: Eliminating Dequantization Bottleneck via Activation Decomposition for Efficient LLM Inference
Lingchao Zheng, Yuwei Fan, Jun Li +5
Quantization is essential for efficient large language model (LLM) inference, yet the dequantization step-converting low-bit weights back to high-precision for matrix multiplicatio…
stat.ML2026
AIS: Adaptive Importance Sampling for Quantized RL
Jiajun Zhou, Wei Shao, Lingchao Zheng +2
Reinforcement learning (RL) for large language models (LLMs) is dominated by the cost of rollout generation, which has motivated the use of low-precision rollouts (e.g., FP8) paire…