Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
Expert Threshold Routing for Autoregressive Language Modeling with Dynamic Computation Allocation and Load Balancing
Hanchi Sun, Yixin Liu, Yonghui Wu +1
Token-choice Mixture-of-Experts (TC-MoE) routes each token to a fixed number of experts, limiting dynamic computation allocation and requiring auxiliary losses to maintain load bal…
cs.AI2025
NodeRAG: Structuring Graph-based RAG with Heterogeneous Nodes
Tianyang Xu, Haojie Zheng, Chengze Li +4
Retrieval-augmented generation (RAG) empowers large language models to access external and private corpus, enabling factually consistent responses in specific domains. By exploitin…