4 papers
Dendrograms of Mixing Measures for Softmax-Gated Gaussian Mixture of Experts: Consistency Without Model Sweeps
Do Tien Hai, Trung Nguyen Mai, TrungTin Nguyen +3
We develop a unified statistical framework for softmax-gated Gaussian mixture of experts (SGMoE) that addresses three long-standing obstacles in parameter estimation and model sele…
Revisiting Incremental Stochastic Majorization-Minimization Algorithms with Applications to Mixture of Experts
TrungKhang Tran, TrungTin Nguyen, Gersende Fort +5
Processing high-volume, streaming data is increasingly common in modern statistics and machine learning, where batch-mode algorithms are often impractical because they require repe…
A Unified Framework for Variable Selection in Model-Based Clustering with Missing Not at Random
Binh H. Ho, Long Nguyen Chi, TrungTin Nguyen +3
Model-based clustering integrated with variable selection is a powerful tool for uncovering latent structures within complex data. However, its effectiveness is often hindered by c…
Accelerating Transformers with Spectrum-Preserving Token Merging
Hoai-Chau Tran, Duy M. H. Nguyen, Duy M. Nguyen +7
Increasing the throughput of the Transformer architecture, a foundational component used in numerous state-of-the-art models for vision and language tasks (e.g., GPT, LLaVa), is an…