Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
GMoE: Empowering LLMs Fine-Tuning via MoE Graph Collaboration
Ting Bai, Yue Yu, Le Huang +2
The sparse Mixture-of-Experts (MoE) architecture of large language models (LLMs) confronts an inherent issue of load imbalance arising from the simplistic linear router strategy, w…
cs.LG2025
Graph Foundation Models: Concepts, Opportunities and Challenges
Jiawei Liu, Cheng Yang, Zhiyuan Lu +8
Foundation models have emerged as critical components in a variety of artificial intelligence applications, and showcase significant success in natural language processing and seve…