From the 1 of 3 linked papers with an AI index.
3 papers
cs.LG2026
Beyond Geometric Complementarity: Coherent Overlap in Sparse Mixture-of-Experts Routing
Huiyuan Tian, Bonan Xu, Shijian Li
The paper investigates how sparse mixture-of-experts language models route tokens to multiple experts, showing that expert subspaces overlap substantially yet routing still selects…
cs.CV2026
From Per-Image Low-Rank to Encoding Mismatch: Rethinking Feature Distillation in Vision Transformers
Huiyuan Tian, Bonan Xu, Shijian Li
Feature-map knowledge distillation (KD) transfers internal representations well between comparably sized Vision Transformers (ViTs), but it often fails in compression. We revisit t…
cs.LG2025
Kunlun Anomaly Troubleshooter: Enabling Kernel-Level Anomaly Detection and Causal Reasoning for Large Model Distributed Inference
Yuyang Liu, Jingjing Cai, Jiayi Ren +4
Anomaly troubleshooting for large model distributed inference (LMDI) remains a critical challenge. Resolving anomalies such as inference performance degradation or latency jitter i…