activity
20182023
most citedX-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages

22 citations · 46 across the 18 of their papers we have counts for

collaborators

18 papers

cs.CY2023★ 1 cited

Data Commons

Ramanathan V. Guha, Prashanth Radhakrishnan, Bo Xu +10

Publicly available data from open sources (e.g., United States Census Bureau (Census), World Health Organization (WHO), Intergovernmental Panel on Climate Change (IPCC)) are vital…

cs.CL2023★ 5 cited

A Knowledge-enhanced Two-stage Generative Framework for Medical Dialogue Information Extraction

Zefa Hu, Ziyi Ni, Jing Shi +2

This paper focuses on term-status pair extraction from medical dialogues (MD-TSPE), which is essential in diagnosis dialogue systems and the automatic scribe of electronic medical…

eess.AS2023

P-vectors: A Parallel-Coupled TDNN/Transformer Network for Speaker Verification

Xiyuan Wang, Fangyuan Wang, Bo Xu +2

Typically, the Time-Delay Neural Network (TDNN) and Transformer can serve as a backbone for Speaker Verification (SV). Both of them have advantages and disadvantages from the persp…

cs.CL2023★ 22 cited

X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages

Feilong Chen, Minglun Han, Haozhi Zhao +4

Large language models (LLMs) have demonstrated remarkable language abilities. GPT-4, based on advanced LLMs, exhibits extraordinary multimodal capabilities beyond previous visual l…

eess.AS2023

VILAS: Exploring the Effects of Vision and Language Context in Automatic Speech Recognition

Ziyi Ni, Minglun Han, Feilong Chen +4

Enhancing automatic speech recognition (ASR) performance by leveraging additional multimodal information has shown promising results in previous studies. However, most of these wor…

cs.CL2023

Matching-based Term Semantics Pre-training for Spoken Patient Query Understanding

Zefa Hu, Xiuyi Chen, Haoran Wu +5

Medical Slot Filling (MSF) task aims to convert medical queries into structured information, playing an essential role in diagnosis dialogue systems. However, the lack of sufficien…

cs.CL2023

Knowledge Transfer from Pre-trained Language Models to Cif-based Speech Recognizers via Hierarchical Distillation

Minglun Han, Feilong Chen, Jing Shi +2

Large-scale pre-trained language models (PLMs) have shown great potential in natural language processing tasks. Leveraging the capabilities of PLMs to enhance automatic speech reco…

cs.CV2022

Privileged Prior Information Distillation for Image Matting

Cheng Lyu, Jiake Xie, Bo Xu +6

Performance of trimap-free image matting methods is limited when trying to decouple the deterministic and undetermined regions, especially in the scenes where foregrounds are seman…

cs.MA2022

ASIR: Robust Agent-based Representation Of SIR Model

Boyan Xu

Compartmental models (written as ) and agent-based models (written as ) are dominant methods in the field of epidemic simulation. But in the literature there lacks discussi…

cs.CV2022

Situational Perception Guided Image Matting

Bo Xu, Jiake Xie, Han Huang +4

Most automatic matting methods try to separate the salient foreground from the background. However, the insufficient quantity and subjective bias of the current existing matting da…

cs.CV2022

Improving Cross-Modal Understanding in Visual Dialog via Contrastive Learning

Feilong Chen, Xiuyi Chen, Shuang Xu +1

Visual Dialog is a challenging vision-language task since the visual dialog agent needs to answer a series of questions after reasoning over both the image content and dialog histo…

cs.CV2022★ 2 cited

Semantic Distillation Guided Salient Object Detection

Bo Xu, Guanze Liu, Han Huang +2

Most existing CNN-based salient object detection methods can identify local segmentation details like hair and animal fur, but often misinterpret the real saliency due to the lack…

cs.SD2022★ 11 cited

Discretization and Re-synthesis: an alternative method to solve the Cocktail Party Problem

Jing Shi, Xuankai Chang, Tomoki Hayashi +3

Deep learning based models have significantly improved the performance of speech separation with input mixtures like the cocktail party. Prominent methods (e.g., frequency-domain a…

cond-mat.soft2021

Design of an Adaptive Surface for Space-Reconfigurable Reflectors using Auxetic Lattice Skin

Bin Xu, Houfei Fang, Yangqin He +2

The effect of Poisson's ratio to the reflector reshaping is investigated through mechanical study of reconfigurable reflectors in this paper. The value of Poisson's ratio correspon…

cs.CV2021★ 1 cited

Deep Two-Stream Video Inference for Human Body Pose and Shape Estimation

Ziwen Li, Bo Xu, Han Huang +2

Several video-based 3D pose and shape estimation algorithms have been proposed to resolve the temporal inconsistency of single-image-based methods. However it still remains challen…

cs.CV2021

Virtual Multi-Modality Self-Supervised Foreground Matting for Human-Object Interaction

Bo Xu, Han Huang, Cheng Lu +2

Most existing human matting algorithms tried to separate pure human-only foreground from the background. In this paper, we propose a Virtual Multi-modality Foreground Matting (VMFM…

cs.CV2020★ 3 cited

Discriminative Multi-modality Speech Recognition

Bo Xu, Cheng Lu, Yandong Guo +1

Vision is often used as a complementary modality for audio speech recognition (ASR), especially in the noisy environment where performance of solo audio modality significantly dete…

math.DS2018★ 1 cited

Twisty Takens: A Geometric Characterization of Good Observations on Dense Trajectories

Boyan Xu, Christopher J. Tralie, Alice Antia +2

In nonlinear time series analysis and dynamical systems theory, Takens' embedding theorem states that the sliding window embedding of a generic observation along trajectories in a…