1 citations · 1 across the 3 of their papers we have counts for
5 papers
Before Fusion, Ask What to Keep: Contextual Calibration of Multimodal Signals
Jiyuan Liu, Liangwei Nathan Zheng, Wei Emma Zhang +2
Multimodal systems often benefit from combining information across language, sound, and visual streams, but this benefit is not guaranteed. A modality that is useful for one input…
Tackling Multimodal Learning Challenges with Mixture-of-Expert: A Survey
Liangwei Nathan Zheng, Wei Emma Zhang, Olaf Maennel +2
Mixture-of-Experts (MoE) presents a naturally compatible and scalable framework for multimodal learning, demonstrating strong adaptability across diverse modalities and tasks. Desp…
Rethinking Gating Mechanism in Sparse MoE: Handling Arbitrary Modality Inputs with Confidence-Guided Gate
Liangwei Nathan Zheng, Wei Emma Zhang, Mingyu Guo +2
Effectively managing missing modalities is a fundamental challenge in real-world multimodal learning scenarios, where data incompleteness often results from systematic collection e…
Focal Calibration Loss: Controlling Posterior Distortion in Deep Neural Classifiers
Wenhao Liang, Liangwei Zheng, Wei Zhang +1
Confidence calibration matters wherever a classifier's probabilities, not just its labels, are consumed downstream. We study Focal Calibration Loss (FCL), which adds a squared prob…
SWAP: Exploiting Second-Ranked Logits for Adversarial Attacks on Time Series
Chang George Dong, Liangwei Nathan Zheng, Weitong Chen +2
Time series classification (TSC) has emerged as a critical task in various domains, and deep neural models have shown superior performance in TSC tasks. However, these models are v…