activity
20232025
most citedHow to Bridge the Gap between Modalities: Survey on Multimodal Large Language Model

10 citations · 11 across the 7 of their papers we have counts for

collaborators

7 papers

cs.NI2025

Camel: Energy-Aware LLM Inference on Resource-Constrained Devices

Hao Xu, Long Peng, Shezheng Song +5

Most Large Language Models (LLMs) are currently deployed in the cloud, with users relying on internet connectivity for access. However, this paradigm faces challenges such as netwo…

cs.CV2024★ 1 cited

MOSABench: Multi-Object Sentiment Analysis Benchmark for Evaluating Multimodal Large Language Models Understanding of Complex Image

Shezheng Song, Chengxiang He, Shan Zhao +4

Multimodal large language models (MLLMs) have shown remarkable progress in high-level semantic tasks such as visual question answering, image captioning, and emotion recognition. H…

cs.CL2024

DIM: Dynamic Integration of Multimodal Entity Linking with Large Language Model

Shezheng Song, Shasha Li, Jie Yu +6

Our study delves into Multimodal Entity Linking, aligning the mention in multimodal information with entities in knowledge base. Existing methods are still facing challenges like a…

cs.CL2024

PTA: Enhancing Multimodal Sentiment Analysis through Pipelined Prediction and Translation-based Alignment

Shezheng Song, Shasha Li, Shan Zhao +8

Multimodal aspect-based sentiment analysis (MABSA) aims to understand opinions in a granular manner, advancing human-computer interaction and other fields. Traditionally, MABSA met…

cs.AI2024

DWE+: Dual-Way Matching Enhanced Framework for Multimodal Entity Linking

Shezheng Song, Shasha Li, Shan Zhao +7

Multimodal entity linking (MEL) aims to utilize multimodal information (usually textual and visual information) to link ambiguous mentions to unambiguous entities in knowledge base…

cs.AI2023

A Dual-way Enhanced Framework from Text Matching Point of View for Multimodal Entity Linking

Shezheng Song, Shan Zhao, Chengyu Wang +4

Multimodal Entity Linking (MEL) aims at linking ambiguous mentions with multimodal information to entity in Knowledge Graph (KG) such as Wikipedia, which plays a key role in many a…

cs.CL2023★ 10 cited

How to Bridge the Gap between Modalities: Survey on Multimodal Large Language Model

Shezheng Song, Xiaopeng Li, Shasha Li +5

We explore Multimodal Large Language Models (MLLMs), which integrate LLMs like GPT-4 to handle multimodal data, including text, images, audio, and more. MLLMs demonstrate capabilit…