From the 1 of 10 linked papers with an AI index.
4 papers · 1 filter
ReQuant: Fixed-Grid Discrete Refinement for Post-Training Quantization
Yongge Ma, Guoan Wang, Feiyu Wang +5
Post-training quantization (PTQ) is widely used to reduce the memory and computational cost of large language models. Existing PTQ methods typically obtain an initial quantized mod…
Beyond Rephrasing: Book-Level Organization Improves Synthetic Textbook Data for Mid-Training
Jiawen Tao, Miao Peng, Yaoming Li +7
The paper introduces a pipeline that creates synthetic textbooks by clustering source material, planning hierarchical tables of contents, and assembling sections into full books, s…
ConMoE: Expert-Pool Consolidation via Prototype Reassignment for MoE Compression
Yilun Yao, Jiaming Pan, Elsie Dai +3
Mixture-of-Experts (MoE) language models reduce per-token computation but still require storing and serving all experts, making deployment memory-intensive. Existing post-training…
Harness-Bench: Measuring Harness Effects across Models in Realistic Agent Workflows
Yilun Yao, Xinyu Tan, Chao-Hsuan Liu +9
LLM agents are increasingly deployed as executable systems that use tools, modify workspaces, and produce concrete artifacts. In such workflows, performance depends not only on the…