6 papers
Hierarchical Copula-Gumbel-Top-K Routing: Two-Sided Dependence Control for Frozen Mixture-of-Experts at Fixed Per-Token Routing Laws
Richard Yi Da Xu
A stochastic Gumbel-Top-K router defines, for every token of a mixture-of-experts (MoE) model, a routing law: a distribution over ordered expert lists and mixture weights. We ask w…
Spectral Certificates and Projection-DPP Rounding for Determinantal MAP Selection
Richard Yi Da Xu
Selecting a fixed-size subset that maximizes the determinant of a positive semidefinite kernel is the MAP problem for a size-constrained determinantal point process and the classic…
Rethinking Generalization in Graph Neural Networks: A Structural Complexity Perspective
Peiyao Wang, Liang Bai, Xian Yang +2
Graph neural networks (GNNs) have emerged as a fundamental tool for learning from graph-structured data, achieving strong performance across a wide range of applications. However,…
Deep Sparse Latent Feature Models for Knowledge Graph Completion
Haotian Li, Rui Zhang, Lingzhi Wang +6
Recent advances in knowledge graph completion (KGC) have emphasized text-based approaches to navigate the inherent complexities of large-scale knowledge graphs (KGs). While these m…
KERMIT: Knowledge Graph Completion of Enhanced Relation Modeling with Inverse Transformation
Haotian Li, Bin Yu, Yuliang Wei +3
Knowledge graph completion (KGC) revolves around populating missing triples in a knowledge graph using available information. Text-based methods, which depend on textual descriptio…
TsCA: On the Semantic Consistency Alignment via Conditional Transport for Compositional Zero-Shot Learning
Miaoge Li, Jingcai Guo, Richard Yi Da Xu +4
Compositional Zero-Shot Learning (CZSL) aims to recognize novel state-object compositions by leveraging the shared knowledge of their primitive components. Despite considerable pro…