activity
20232026
most citedCompeteSMoE -- Effective Training of Sparse Mixture of Experts via Competition

1 citations · 1 across the 5 of their papers we have counts for

collaborators

6 papers

cs.AI2026

MORPH: Generative Retrieval via Diffusion Transformer with Metric-Ordered Sequence Training and Hybrid-Policy Preference Optimization

Chenghao Liu, Yu Zhang, Zhongtao Jiang +7

Embedding-based retrieval typically returns highest-scoring items, but many production scenarios require items that satisfy a target attribute while preserving a fine-grained patte…

cs.RO2026

What Frozen VLAs Already Know About Success: A Probing Study of Value-Like Structure in Foundation Robot Policies

Jiachen Zhang, Junnan Nie, Junyi Lao +4

Vision--language--action (VLA) policies are trained to imitate actions; their loss never asks them to estimate reward, progress, or future success. Their frozen representations nev…

cs.LG2026

TSFMAudit: Data Contamination Auditing in Forecasting Time Series Foundation Models

Hongkai Li, Shifeng Xie, Lefei Shen +7

Time series foundation models (TSFMs) are increasingly pretrained on large corpora, raising concerns that evaluation datasets may have been exposed during pretraining and thus yiel…

cs.LG2025

Multi-Scale Finetuning for Encoder-based Time Series Foundation Models

Zhongzheng Qiao, Chenghao Liu, Yiming Zhang +6

Time series foundation models (TSFMs) demonstrate impressive zero-shot performance for time series forecasting. However, an important yet underexplored challenge is how to effectiv…

cs.LG2024★ 1 cited

CompeteSMoE -- Effective Training of Sparse Mixture of Experts via Competition

Quang Pham, Giang Do, Huy Nguyen +8

Sparse mixture of experts (SMoE) offers an appealing solution to scale up the model complexity beyond the mean of increasing the network's depth or width. However, effective traini…

cs.LG2023

HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts

Giang Do, Khiem Le, Quang Pham +7

By routing input tokens to only a few split experts, Sparse Mixture-of-Experts has enabled efficient training of large language models. Recent findings suggest that fixing the rout…