activity
20232025
most citedCompeteSMoE -- Effective Training of Sparse Mixture of Experts via Competition

1 citations · 3 across the 8 of their papers we have counts for

collaborators

10 papers

cs.LG2025

PROL : Rehearsal Free Continual Learning in Streaming Data via Prompt Online Learning

M. Anwar Ma'sum, Mahardhika Pratama, Savitha Ramasamy +3

The data privacy constraint in online continual learning (OCL), where the data can be seen only once, complicates the catastrophic forgetting problem in streaming data. A common ap…

cs.LG2025

Multi-Scale Finetuning for Encoder-based Time Series Foundation Models

Zhongzheng Qiao, Chenghao Liu, Yiming Zhang +6

Time series foundation models (TSFMs) demonstrate impressive zero-shot performance for time series forecasting. However, an important yet underexplored challenge is how to effectiv…

cs.AI2025

CompeteSMoE -- Statistically Guaranteed Mixture of Experts Training via Competition

Nam V. Nguyen, Huy Nguyen, Quang Pham +3

Sparse mixture of experts (SMoE) offers an appealing solution to scale up the model complexity beyond the mean of increasing the network's depth or width. However, we argue that ef…

cs.LG2025

Sequence Transferability and Task Order Selection in Continual Learning

Thinh Nguyen, Cuong N. Nguyen, Quang Pham +4

In continual learning, understanding the properties of task sequences and their relationships to model performance is important for developing advanced algorithms with better accur…

cs.LG2024★ 1 cited

PIP: Prototypes-Injected Prompt for Federated Class Incremental Learning

Muhammad Anwar Ma'sum, Mahardhika Pratama, Savitha Ramasamy +3

Federated Class Incremental Learning (FCIL) is a new direction in continual learning (CL) for addressing catastrophic forgetting and non-IID data distribution simultaneously. Exist…

cs.RO2024

Continual Learning for Robust Gate Detection under Dynamic Lighting in Autonomous Drone Racing

Zhongzheng Qiao, Xuan Huy Pham, Savitha Ramasamy +3

In autonomous and mobile robotics, a principal challenge is resilient real-time environmental perception, particularly in situations characterized by unknown and dynamic elements,…

cs.LG2024★ 1 cited

CompeteSMoE -- Effective Training of Sparse Mixture of Experts via Competition

Quang Pham, Giang Do, Huy Nguyen +8

Sparse mixture of experts (SMoE) offers an appealing solution to scale up the model complexity beyond the mean of increasing the network's depth or width. However, effective traini…

cs.LG2024★ 1 cited

Class-incremental Learning for Time Series: Benchmark and Evaluation

Zhongzheng Qiao, Quang Pham, Zhen Cao +4

Real-world environments are inherently non-stationary, frequently introducing new classes over time. This is especially common in time series classification, such as the emergence…

cs.LG2024

Dynamic Long-Term Time-Series Forecasting via Meta Transformer Networks

Muhammad Anwar Ma'sum, MD Rasel Sarkar, Mahardhika Pratama +5

A reliable long-term time-series forecaster is highly demanded in practice but comes across many challenges such as low computational and memory footprints as well as robustness ag…

cs.LG2023

HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts

Giang Do, Khiem Le, Quang Pham +7

By routing input tokens to only a few split experts, Sparse Mixture-of-Experts has enabled efficient training of large language models. Recent findings suggest that fixing the rout…