8 citations · 9 across the 6 of their papers we have counts for
7 papers
What Really Works for Universal Multimodal Embeddings? A Controlled Study of Contrastive Training Strategies
Duo Li, Haojun Pan, Zuhao Yang +4
Contrastive learning has become the standard paradigm for multimodal representation learning, aligning semantically matched pairs while separating mismatched ones in a shared embed…
A Comprehensive Study on Visual Token Redundancy for Discrete Diffusion-based Multimodal Large Language Models
Duo Li, Zuhao Yang, Xiaoqin Zhang +2
Discrete diffusion-based multimodal large language models (dMLLMs) have emerged as a promising alternative to autoregressive MLLMs thanks to their advantages in parallel decoding a…
ToDRE: Effective Visual Token Pruning via Token Diversity and Task Relevance
Duo Li, Zuhao Yang, Xiaoqin Zhang +2
Visual token pruning, which aims to compress and prune redundant visual tokens, plays a critical role in efficient inference with large vision-language models (LVLMs). However, exi…
DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training
Masahiro Tanaka, Du Li, Umesh Chand +3
The rapid growth of deep learning models has increased the demand for efficient distributed training strategies. Fully sharded approaches like ZeRO-3 and FSDP partition model param…
Efficient Diffusion Transformer with Step-wise Dynamic Attention Mediators
Yifan Pu, Zhuofan Xia, Jiayi Guo +9
This paper identifies significant redundancy in the query-key interactions within self-attention mechanisms of diffusion transformer models, particularly during the early stages of…
MCSD: An Efficient Language Model with Diverse Fusion
Hua Yang, Duohai Li, Shiman Li
Transformers excel in Natural Language Processing (NLP) due to their prowess in capturing long-term dependencies but suffer from exponential resource consumption with increasing se…
DeepSpeed Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale
Reza Yazdani Aminabadi, Samyam Rajbhandari, Minjia Zhang +8
The past several years have witnessed the success of transformer-based models, and their scale and application scenarios continue to grow aggressively. The current landscape of tra…