674 citations
- University of Illinois ChicagoUS13 papers
- Singapore Management UniversitySG11 papers
- Carnegie Mellon UniversityUS8 papers
- Georgia Institute of TechnologyUS7 papers
- Princeton UniversityUS7 papers
- Nanyang Technological UniversitySG6 papers
- University of Illinois Urbana-ChampaignUS6 papers
- Agency for Science, Technology and ResearchSG5 papers
- Chinese University of Hong KongHK5 papers
- University of Maryland, College ParkUS5 papers
- University of WashingtonUS5 papers
- Beihang UniversityCN4 papers
5 papers · 1 filter
HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts
Giang Do, Khiem Le, Quang Pham +7
By routing input tokens to only a few split experts, Sparse Mixture-of-Experts has enabled efficient training of large language models. Recent findings suggest that fixing the rout…
Graph-based Alignment and Uniformity for Recommendation
Liangwei Yang, Zhiwei Liu, Chen Wang +4
Collaborative filtering-based recommender systems (RecSys) rely on learning representations for users and items to predict preferences accurately. Representation learning on the hy…
Group Identification via Transitional Hypergraph Convolution with Cross-view Self-supervised Learning
Mingdai Yang, Zhiwei Liu, Liangwei Yang +4
With the proliferation of social media, a growing number of users search for and join group activities in their daily life. This develops a need for the study on the group identifi…
A Data-centric Framework for Improving Domain-specific Machine Reading Comprehension Datasets
Iva Bojic, Josef Halim, Verena Suharman +6
Low-quality data can cause downstream problems in high-stakes applications. Data-centric approach emphasizes on improving dataset quality to enhance model performance. High-quality…
A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT
Ce Zhou, Qian Li, Chen Li +16
Pretrained Foundation Models (PFMs) are regarded as the foundation for various downstream tasks with different data modalities. A PFM (e.g., BERT, ChatGPT, and GPT-4) is trained on…