activity
20202024
most citedKnowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

31 citations · 131 across the 30 of their papers we have counts for

collaborators

31 papers

cs.CL2024★ 3 cited

Noise-powered Multi-modal Knowledge Graph Representation Framework

Zhuo Chen, Yin Fang, Yichi Zhang +5

The rise of Multi-modal Pre-training highlights the necessity for a unified Multi-Modal Knowledge Graph (MMKG) representation learning framework. Such a framework is essential for…

cs.AI2024★ 31 cited

Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

Zhuo Chen, Yichi Zhang, Yin Fang +12

Knowledge Graphs (KGs) play a pivotal role in advancing various AI applications, with the semantic web community's exploration into multi-modal dimensions unlocking new avenues for…

cs.AI2024★ 7 cited

Unleashing the Power of Imbalanced Modality Information for Multi-modal Knowledge Graph Completion

Yichi Zhang, Zhuo Chen, Lei Liang +2

Multi-modal knowledge graph completion (MMKGC) aims to predict the missing triples in the multi-modal knowledge graphs by incorporating structural, visual, and textual information…

cs.CL2023★ 16 cited

Prompting Disentangled Embeddings for Knowledge Graph Completion with Pre-trained Language Model

Yuxia Geng, Jiaoyan Chen, Yuhang Zeng +5

Both graph structures and textual information play a critical role in Knowledge Graph Completion (KGC). With the success of Pre-trained Language Models (PLMs) such as BERT, they ha…

cs.CL2023

MACO: A Modality Adversarial and Contrastive Framework for Modality-missing Multi-modal Knowledge Graph Completion

Yichi Zhang, Zhuo Chen, Wen Zhang

Recent years have seen significant advancements in multi-modal knowledge graph completion (MMKGC). MMKGC enhances knowledge graph completion (KGC) by integrating multi-modal entity…

cs.AI2023

Large Language Models and Knowledge Graphs: Opportunities and Challenges

Jeff Z. Pan, Simon Razniewski, Jan-Christoph Kalo +13

Large Language Models (LLMs) have taken Knowledge Representation -- and the world -- by storm. This inflection point marks a shift from explicit knowledge representation to a renew…

cs.AI2023★ 2 cited

Rethinking Uncertainly Missing and Ambiguous Visual Modality in Multi-Modal Entity Alignment

Zhuo Chen, Lingbing Guo, Yin Fang +6

As a crucial extension of entity alignment (EA), multi-modal entity alignment (MMEA) aims to identify identical entities across disparate knowledge graphs (KGs) by exploiting assoc…

cs.CL2023★ 1 cited

CausE: Towards Causal Knowledge Graph Embedding

Yichi Zhang, Wen Zhang

Knowledge graph embedding (KGE) focuses on representing the entities and relations of a knowledge graph (KG) into the continuous vector spaces, which can be employed to predict the…

cs.CL2023★ 1 cited

Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representations

Yufeng Huang, Jiji Tang, Zhuo Chen +8

Large-scale vision-language pre-training has achieved significant performance in multi-modal understanding and generation tasks. However, existing methods often perform poorly on i…

cs.AI2023

NeuralKG-ind: A Python Library for Inductive Knowledge Graph Representation Learning

Wen Zhang, Zhen Yao, Mingyang Chen +2

Since the dynamic characteristics of knowledge graphs, many inductive knowledge graph representation learning (KGRL) works have been proposed in recent years, focusing on enabling…

cs.CL2023★ 1 cited

Modality-Aware Negative Sampling for Multi-modal Knowledge Graph Embedding

Yichi Zhang, Mingyang Chen, Wen Zhang

Negative sampling (NS) is widely used in knowledge graph embedding (KGE), which aims to generate negative triples to make a positive-negative contrast during training. However, exi…

cs.LG2023★ 1 cited

Structure Pretraining and Prompt Tuning for Knowledge Graph Transfer

Wen Zhang, Yushan Zhu, Mingyang Chen +5

Knowledge graphs (KG) are essential background knowledge providers in many tasks. When designing models for KG-related tasks, one of the key tasks is to devise the Knowledge Repres…

cs.AI2023

Analogical Inference Enhanced Knowledge Graph Embedding

Zhen Yao, Wen Zhang, Mingyang Chen +3

Knowledge graph embedding (KGE), which maps entities and relations in a knowledge graph into continuous vector spaces, has achieved great success in predicting missing links in kno…

cs.CL2023

Entity-Agnostic Representation Learning for Parameter-Efficient Knowledge Graph Embedding

Mingyang Chen, Wen Zhang, Zhen Yao +4

We propose an entity-agnostic representation learning method for handling the problem of inefficient parameter storage costs brought by embedding knowledge graphs. Conventional kno…

cs.CL2023★ 1 cited

Generalizing to Unseen Elements: A Survey on Knowledge Extrapolation for Knowledge Graphs

Mingyang Chen, Wen Zhang, Yuxia Geng +3

Knowledge graphs (KGs) have become valuable knowledge resources in various applications, and knowledge graph embedding (KGE) methods have garnered increasing attention in recent ye…

cs.AI2022★ 5 cited

MEAformer: Multi-modal Entity Alignment Transformer for Meta Modality Hybrid

Zhuo Chen, Jiaoyan Chen, Wen Zhang +8

Multi-modal entity alignment (MMEA) aims to discover identical entities across different knowledge graphs (KGs) whose entities are associated with relevant images. However, current…

cs.AI2022★ 1 cited

Tele-Knowledge Pre-training for Fault Analysis

Zhuo Chen, Wen Zhang, Yufeng Huang +14

In this work, we share our experience on tele-knowledge pre-training for fault analysis, a crucial task in telecommunication applications that requires a wide range of knowledge no…

cs.AI2022★ 7 cited

Relational Message Passing for Fully Inductive Knowledge Graph Completion

Yuxia Geng, Jiaoyan Chen, Jeff Z. Pan +4

In knowledge graph completion (KGC), predicting triples involving emerging entities and/or relations, which are unseen when the KG embeddings are learned, has become a critical cha…

cs.AI2022★ 7 cited

Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Sampling

Yichi Zhang, Wen Zhang

Knowledge graphs (KGs) that modelings the world knowledge as structural triples are inevitably incomplete. Such problems still exist for multimodal knowledge graphs (MMKGs). Thus,…

cs.CV2022★ 2 cited

Target-oriented Sentiment Classification with Sequential Cross-modal Semantic Graph

Yufeng Huang, Zhuo Chen, Jiaoyan Chen +3

Multi-modal aspect-based sentiment classification (MABSC) is task of classifying the sentiment of a target entity mentioned in a sentence and an image. However, previous methods fa…

cs.CV2022★ 1 cited

LaKo: Knowledge-driven Visual Question Answering via Late Knowledge-to-Text Injection

Zhuo Chen, Yufeng Huang, Jiaoyan Chen +5

Visual question answering (VQA) often requires an understanding of visual concepts and language semantics, which relies on external knowledge. Most existing methods exploit pre-tra…

cs.CV2022★ 3 cited

DUET: Cross-modal Semantic Grounding for Contrastive Zero-shot Learning

Zhuo Chen, Yufeng Huang, Jiaoyan Chen +5

Zero-shot learning (ZSL) aims to predict unseen classes whose samples have never appeared during training. One of the most effective and widely used semantic information for zero-s…

cs.AI2022

Disentangled Ontology Embedding for Zero-shot Learning

Yuxia Geng, Jiaoyan Chen, Wen Zhang +6

Knowledge Graph (KG) and its variant of ontology have been widely used for knowledge representation, and have shown to be quite effective in augmenting Zero-shot Learning (ZSL). Ho…

cs.CL2022★ 6 cited

Meta-Learning Based Knowledge Extrapolation for Knowledge Graphs in the Federated Setting

Mingyang Chen, Wen Zhang, Zhen Yao +4

We study the knowledge extrapolation problem to embed new components (i.e., entities and relations) that come with emerging knowledge graphs (KGs) in the federated setting. In this…