31 citations · 62 across the 19 of their papers we have counts for
6 papers · 1 filter
Structured and Abstractive Reasoning on Multi-modal Relational Knowledge Images
Yichi Zhang, Zhuo Chen, Lingbing Guo +2
Understanding and reasoning with abstractive information from the visual modality presents significant challenges for current multi-modal large language models (MLLMs). Among the v…
Collaboration of Fusion and Independence: Hypercomplex-driven Robust Multi-Modal Knowledge Graph Completion
Zhiqiang Liu, Yichi Zhang, Mengshu Sun +2
Multi-modal knowledge graph completion (MMKGC) aims to discover missing facts in multi-modal knowledge graphs (MMKGs) by leveraging both structural relationships and diverse modali…
Abstractive Visual Understanding of Multi-modal Structured Knowledge: A New Perspective for MLLM Evaluation
Yichi Zhang, Zhuo Chen, Lingbing Guo +4
Multi-modal large language models (MLLMs) incorporate heterogeneous modalities into LLMs, enabling a comprehensive understanding of diverse scenarios and objects. Despite the proli…
Multi-modal Knowledge Graph Generation with Semantics-enriched Prompts
Yajing Xu, Zhiqiang Liu, Jiaoyan Chen +7
Multi-modal Knowledge Graphs (MMKGs) have been widely applied across various domains for knowledge representation. However, the existing MMKGs are significantly fewer than required…
K-ON: Stacking Knowledge On the Head Layer of Large Language Model
Lingbing Guo, Yichi Zhang, Zhongpu Bo +5
Recent advancements in large language models (LLMs) have significantly improved various natural language processing (NLP) tasks. Typically, LLMs are trained to predict the next tok…
OntoTune: Ontology-Driven Self-training for Aligning Large Language Models
Zhiqiang Liu, Chengtao Gan, Junjie Wang +5
Existing domain-specific Large Language Models (LLMs) are typically developed by fine-tuning general-purposed LLMs with large-scale domain-specific corpora. However, training on la…