3 papers
cs.LG2026
Fairy2i: Training Complex LLMs from Real LLMs with All Parameters in
Feiyu Wang, Xinyu Tan, Bokai Huang +4
Large language models (LLMs) have revolutionized artificial intelligence, yet their massive memory and computational demands necessitate aggressive quantization, increasingly pushi…
cs.LG2025
iFairy: the First 2-bit Complex LLM with All Parameters in
Feiyu Wang, Guoan Wang, Yihao Zhang +7
Quantization-Aware Training (QAT) integrates quantization into the training loop, enabling LLMs to learn robust low-bit representations, and is widely recognized as one of the most…
cs.LG2024
Causal Abstraction in Model Interpretability: A Compact Survey
Yihao Zhang
The pursuit of interpretable artificial intelligence has led to significant advancements in the development of methods that aim to explain the decision-making processes of complex…