79 citations · 112 across the 17 of their papers we have counts for
19 papers
Multi-modality Image Fusion under Adverse Weather: Mask-Guided Feature Restoration and Interaction
Xilai Li, Xiaosong Li, Haishu Tan +3
Multi-modality image fusion (MMIF) enhances scene representation by exploiting complementary cues from different modalities. Adverse weather, however, causes significant image degr…
FTPFusion: Frequency-Aware Infrared and Visible Video Fusion with Temporal Perturbation
Xilai Li, Chusheng Fang, Xiaosong Li
Infrared and visible video fusion plays a critical role in intelligent surveillance and low-light monitoring. However, maintaining temporal stability while preserving spatial detai…
MAVFusion: Efficient Infrared and Visible Video Fusion via Motion-Aware Sparse Interaction
Xilai Li, Weijun Jiang, Xiaosong Li +5
Infrared and visible video fusion combines the object saliency from infrared images with the texture details from visible images to produce semantically rich fusion results. Howeve…
Text-Guided Channel Perturbation and Pretrained Knowledge Integration for Unified Multi-Modality Image Fusion
Xilai Li, Xiaosong Li, Weijun Jiang
Multi-modality image fusion enhances scene perception by combining complementary information. Unified models aim to share parameters across modalities for multi-modality image fusi…
AWM-Fuse: Multi-Modality Image Fusion for Adverse Weather via Global and Local Text Perception
Xilai Li, Huichun Liu, Xiaosong Li +3
Multi-modality image fusion (MMIF) in adverse weather aims to address the loss of visual information caused by weather-related degradations, providing clearer scene representations…
Exploring Linear Attention Alternative for Single Image Super-Resolution
Rongchang Lu, Changyu Li, Donghang Li +3
Deep learning-based single-image super-resolution (SISR) technology focuses on enhancing low-resolution (LR) images into high-resolution (HR) ones. Although significant progress ha…
SpeechVerse: A Large-scale Generalizable Audio Language Model
Nilaksh Das, Saket Dingliwal, Srikanth Ronanki +14
Large language models (LLMs) have shown incredible proficiency in performing tasks that require semantic understanding of natural language instructions. Recently, many works have f…
MMA-UNet: A Multi-Modal Asymmetric UNet Architecture for Infrared and Visible Image Fusion
Jingxue Huang, Xilai Li, Tianshu Tan +2
Multi-modal image fusion (MMIF) maps useful information from various modalities into the same representation space, thereby producing an informative fused image. However, the exist…
UMCFuse: A Unified Multiple Complex Scenes Infrared and Visible Image Fusion Framework
Xilai Li, Xiaosong Li, Tianshu Tan +2
Infrared and visible image fusion has emerged as a prominent research area in computer vision. However, little attention has been paid to the fusion task in complex scenes, leading…
All-weather Multi-Modality Image Fusion: Unified Framework and 100k Benchmark
Xilai Li, Wuyang Liu, Xiaosong Li +3
Multi-modality image fusion (MMIF) combines complementary information from different image modalities to provide a comprehensive and objective interpretation of scenes. However, ex…
SAMF: Small-Area-Aware Multi-focus Image Fusion for Object Detection
Xilai Li, Xiaosong Li, Haishu Tan +1
Existing multi-focus image fusion (MFIF) methods often fail to preserve the uncertain transition region and detect small focus areas within large defocused regions accurately. To a…
Bridging the Gap between Multi-focus and Multi-modal: A Focused Integration Framework for Multi-modal Image Fusion
Xilai Li, Xiaosong Li, Tao Ye +3
Multi-modal image fusion (MMIF) integrates valuable information from different modality images into a fused one. However, the fusion of multiple visible images with different focal…
DCTX-Conformer: Dynamic context carry-over for low latency unified streaming and non-streaming Conformer ASR
Goeric Huybrechts, Srikanth Ronanki, Xilai Li +3
Conformer-based end-to-end models have become ubiquitous these days and are commonly used in both streaming and non-streaming automatic speech recognition (ASR). Techniques like du…
Masked Audio Text Encoders are Effective Multi-Modal Rescorers
Jinglun Cai, Monica Sunkara, Xilai Li +3
Masked Language Models (MLMs) have proven to be effective for second-pass rescoring in Automatic Speech Recognition (ASR) systems. In this work, we propose Masked Audio Text Encode…
Dynamic Chunk Convolution for Unified Streaming and Non-Streaming Conformer ASR
Xilai Li, Goeric Huybrechts, Srikanth Ronanki +2
Recently, there has been an increasing interest in unifying streaming and non-streaming speech recognition models to reduce development, training and deployment cost. The best-know…
Attentive Normalization
Xilai Li, Wei Sun, Tianfu Wu
In state-of-the-art deep neural networks, both feature normalization and feature attention have become ubiquitous. % with significant performance improvement shown in a vast amount…
Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgetting
Xilai Li, Yingbo Zhou, Tianfu Wu +2
Addressing catastrophic forgetting is one of the key challenges in continual learning where machine learning systems are trained with sequential or streaming tasks. Despite recent…
AOGNets: Compositional Grammatical Architectures for Deep Learning
Xilai Li, Xi Song, Tianfu Wu
Neural architectures are the foundation for improving performance of deep neural networks (DNNs). This paper presents deep compositional grammatical architectures which harness the…
Towards Interpretable R-CNN by Unfolding Latent Structures
Tianfu Wu, Wei Sun, Xilai Li +2
This paper first proposes a method of formulating model interpretability in visual understanding tasks based on the idea of unfolding latent structures. It then presents a case stu…