2 citations · 2 across the 6 of their papers we have counts for
6 papers
Modeling Expert Interactions in Sparse Mixture of Experts via Graph Structures
Minh-Khoi Nguyen-Nhat, Rachel S. Y. Teo, Laziz Abdullaev +3
Sparse Mixture of Experts (SMoE) has emerged as a promising solution to achieving unparalleled scalability in deep learning by decoupling model parameter count from computational c…
LLMPerf: GPU Performance Modeling meets Large Language Models
Khoi N. M. Nguyen, Hoang Duy Nguyen Do, Huyen Thao Le +1
Performance modeling, a pivotal domain in program cost analysis, currently relies on manually crafted models constrained by various program and hardware limitations, especially in…
Equivariant Polynomial Functional Networks
Thieu N. Vo, Viet-Hoang Tran, Tho Tran Huu +5
Neural Functional Networks (NFNs) have gained increasing interest due to their wide range of applications, including extracting information from implicit representations of data, e…
Equivariant Neural Functional Networks for Transformers
Viet-Hoang Tran, Thieu N. Vo, An Nguyen The +5
This paper systematically explores neural functional networks (NFN) for transformer architectures. NFN are specialized neural networks that treat the weights, gradients, or sparsit…
Tree-Sliced Wasserstein Distance: A Geometric Perspective
Viet-Hoang Tran, Trang Pham, Tho Tran +4
Many variants of Optimal Transport (OT) have been developed to address its heavy computation. Among them, notably, Sliced Wasserstein (SW) is widely used for application domains by…
TextANIMAR: Text-based 3D Animal Fine-Grained Retrieval
Trung-Nghia Le, Tam V. Nguyen, Minh-Quan Le +30
3D object retrieval is an important yet challenging task that has drawn more and more attention in recent years. While existing approaches have made strides in addressing this issu…