activity
20202024
most citedNExT-GPT: Any-to-Any Multimodal LLM

95 citations · 659 across the 48 of their papers we have counts for

collaborators
Showing 2024Show all

7 papers · 1 filter

cs.CV2024★ 63 cited

Enhancing Video-Language Representations with Structural Spatio-Temporal Alignment

Hao Fei, Shengqiong Wu, Meishan Zhang +3

While pre-training large-scale video-language models (VLMs) has shown remarkable potential for various downstream video-language tasks, existing VLMs can still suffer from certain…

cs.MM2024★ 5 cited

Recognizing Everything from All Modalities at Once: Grounded Multimodal Universal Information Extraction

Meishan Zhang, Hao Fei, Bin Wang +4

In the field of information extraction (IE), tasks across a wide range of modalities and their combinations have been traditionally studied in isolation, leaving a gap in deeply re…

cs.CV2024★ 2 cited

Towards Semantic Equivalence of Tokenization in Multimodal LLM

Shengqiong Wu, Hao Fei, Xiangtai Li +4

Multimodal Large Language Models (MLLMs) have demonstrated exceptional capabilities in processing vision-language tasks. One of the crux of MLLMs lies in vision tokenization, which…

q-bio.QM2024★ 3 cited

ProtT3: Protein-to-Text Generation for Text-based Protein Understanding

Zhiyuan Liu, An Zhang, Hao Fei +4

Language Models (LMs) excel in understanding textual descriptions of proteins, as evident in biomedical question-answering tasks. However, their capability falters with raw protein…

cs.CL2024

Modeling Unified Semantic Discourse Structure for High-quality Headline Generation

Minghui Xu, Hao Fei, Fei Li +4

Headline generation aims to summarize a long document with a short, catchy title that reflects the main idea. This requires accurately capturing the core document semantics, which…

cs.CL2024★ 1 cited

In-Context Learning for Few-Shot Nested Named Entity Recognition

Meishan Zhang, Bin Wang, Hao Fei +1

In nested Named entity recognition (NER), entities are nested with each other, and thus requiring more data annotations to address. This leads to the development of few-shot nested…

cs.LG2024

Improving Expressive Power of Spectral Graph Neural Networks with Eigenvalue Correction

Kangkang Lu, Yanhua Yu, Hao Fei +6

In recent years, spectral graph neural networks, characterized by polynomial filters, have garnered increasing attention and have achieved remarkable performance in tasks such as n…