3 papers
cs.AI2026
InferOpt: Constrained Multi-Objective Search for LLM Inference Configurations
Qi Chen, Yingying Cheng, Zhaoyi Sun +3
Serving an LLM means setting dozens of inference-time knobs, from per-layer KV retention to per-layer expert counts. Practice sets them with mechanism-specific heuristics that retu…
cs.LG2026
Max-Window Scale Estimation for Near-Lossless HiF8 W8A8 Quantization-Aware Training
Yingying Cheng, Jinquan Shi, Li Zhou +4
Quantization-aware training (QAT) with low-bit floating-point formats enables efficient LLM deployment, yet introduces subtle failure modes invisible to standard training metrics.…
cs.CV2026
TextBoost: Boosting Scene Text Fidelity in Ultra-low Bitrate Image Compression
Bingxin Wang, Yuan Lan, Zhaoyi Sun +2
Ultra-low bitrate image compression faces a critical challenge: preserving small-font scene text while maintaining overall visual quality. Region-of-interest (ROI) bit allocation c…