61 citations · 231 across the 34 of their papers we have counts for
35 papers
FITTER: Vocabulary-Agnostic Cross-Domain Inference on Temporal Knowledge Graphs
Jiaxin Pan, Mojtaba Nayyeri, Osama Mohammed +4
Temporal knowledge graphs are central to many uses of the Semantic Web, but existing completion methods assume the entities, relation names, and timestamps to be reasoned about are…
STEREODISCO: Discovering Stereotypicality in LLMs
Farane Jalali Farahani, Corina Dima, Mojtaba Nayyeri +2
LLMs encode, convey, and perpetuate stereotypes. Prior computational research focuses on a small set of semantic axes investigated in social psychology, and operates on word embedd…
Leveraging Graph Structure in Seq2Seq Models for Knowledge Graph Link Prediction
Luu Huu Phuc, Ratan Bahadur Thapa, Mojtaba Nayyeri +3
We introduce Graph-Augmented Sequence-to-Sequence (GA-S2S), a novel framework that integrates a T5-small encoder-decoder with a Relational Graph Attention Network (RGAT) to improve…
Towards Foundation Models for Relational Databases with Language Models and Graph Neural Networks
Jingcheng Wu, Ratan Bahadur Thapa, Mojtaba Nayyeri +4
Relational databases store much of the world's structured information, and they are essential for driving complex predictive applications. However, deep learning progress on relati…
Geometric Structural Knowledge Graph Foundation Model
Ling Xin, Mojtaba Nayyeri, Zahra Makki Nayeri +1
Structural knowledge graph foundation models aim to generalize reasoning to completely new graphs with unseen entities and relations. A key limitation of existing approaches like U…
Full-History Graphs with Edge-Type Decoupled Networks for Temporal Reasoning
Osama Mohammed, Jiaxin Pan, Mojtaba Nayyeri +2
Modeling evolving interactions among entities is critical in many real-world tasks. For example, predicting driver maneuvers in traffic requires tracking how neighboring vehicles a…
Mathematical Reasoning for Unmanned Aerial Vehicles: A RAG-Based Approach for Complex Arithmetic Reasoning
Mehdi Azarafza, Mojtaba Nayyeri, Faezeh Pasandideh +2
Autonomous UAV operation necessitates reliable mathematical reasoning for tasks such as trajectory planning and power management. While traditional flight control relies on hardcod…
Towards Foundation Model on Temporal Knowledge Graph Reasoning
Jiaxin Pan, Mojtaba Nayyeri, Osama Mohammed +4
Temporal Knowledge Graphs (TKGs) store temporal facts with quadruple formats (s, p, o, t). Existing Temporal Knowledge Graph Embedding (TKGE) models perform link prediction tasks i…
Retrieval-Augmented Generation of Ontologies from Relational Databases
Nadeen Fathallah, Mojtaba Nayyeri, Athish A Yogi +4
Deriving OWL ontologies from relational database schemas supports semantic interoperability and downstream tasks such as knowledge graph population, ontology-based data access, gra…
SEMMA: A Semantic Aware Knowledge Graph Foundation Model
Arvindh Arun, Sumit Kumar, Mojtaba Nayyeri +4
Knowledge Graph Foundation Models (KGFMs) have shown promise in enabling zero-shot reasoning over unseen graphs by learning transferable patterns. However, most existing KGFMs rely…
Expanding Expressivity in Transformer Models with MöbiusAttention
Anna-Maria Halacheva, Mojtaba Nayyeri, Steffen Staab
Attention mechanisms and Transformer architectures have revolutionized Natural Language Processing (NLP) by enabling exceptional modeling of long-range dependencies and capturing i…
Generating Ontologies via Knowledge Graph Query Embedding Learning
Yunjie He, Daniel Hernandez, Mojtaba Nayyeri +4
Query embedding approaches answer complex logical queries over incomplete knowledge graphs (KGs) by computing and operating on low-dimensional vector representations of entities, r…
Predictive Multiplicity of Knowledge Graph Embeddings in Link Prediction
Yuqicheng Zhu, Nico Potyka, Mojtaba Nayyeri +4
Knowledge graph embedding (KGE) models are often used to predict missing links for knowledge graphs (KGs). However, multiple KG embeddings can perform almost equally well for link…
Approximating Probabilistic Inference in Statistical EL with Knowledge Graph Embeddings
Yuqicheng Zhu, Nico Potyka, Bo Xiong +4
Statistical information is ubiquitous but drawing valid conclusions from it is prohibitively hard. We explain how knowledge graph embeddings can be used to approximate probabilisti…
Hybrid Reasoning Based on Large Language Models for Autonomous Car Driving
Mehdi Azarafza, Mojtaba Nayyeri, Charles Steinmetz +2
Large Language Models (LLMs) have garnered significant attention for their ability to understand text and images, generate human-like text, and perform complex reasoning tasks. How…
HGE: Embedding Temporal Knowledge Graphs in a Product Space of Heterogeneous Geometric Subspaces
Jiaxin Pan, Mojtaba Nayyeri, Yinan Li +1
Temporal knowledge graphs represent temporal facts relating a subject and an object via a relation label at time , where could be a time point or tim…
NestE: Modeling Nested Relational Structures for Knowledge Graph Reasoning
Bo Xiong, Mojtaba Nayyeri, Linhao Luo +3
Reasoning with knowledge graphs (KGs) has primarily focused on triple-shaped facts. Recent advancements have been explored to enhance the semantics of these facts by incorporating…
Geometric Relational Embeddings: A Survey
Bo Xiong, Mojtaba Nayyeri, Ming Jin +4
Geometric relational embeddings map relational data as geometric objects that combine vector information suitable for machine learning and structured/relational information for str…
Modeling Relational Patterns for Logical Query Answering over Knowledge Graphs
Yunjie He, Mojtaba Nayyeri, Bo Xiong +3
Answering first-order logical (FOL) queries over knowledge graphs (KG) remains a challenging task mainly due to KG incompleteness. Query embedding approaches this problem by comput…
Link Prediction with Attention Applied on Multiple Knowledge Graph Embedding Models
Cosimo Gregucci, Mojtaba Nayyeri, Daniel Hernández +1
Predicting missing links between entities in a knowledge graph is a fundamental task to deal with the incompleteness of data on the Web. Knowledge graph embeddings map nodes into a…
Integrating Knowledge Graph embedding and pretrained Language Models in Hypercomplex Spaces
Mojtaba Nayyeri, Zihao Wang, Mst. Mahfuja Akter +4
Knowledge Graphs, such as Wikidata, comprise structural and textual knowledge in order to represent knowledge. For each of the two modalities dedicated approaches for graph embeddi…
Ultrahyperbolic Knowledge Graph Embeddings
Bo Xiong, Shichao Zhu, Mojtaba Nayyeri +4
Recent knowledge graph (KG) embeddings have been advanced by hyperbolic geometry due to its superior capability for representing hierarchies. The topological structures of real-wor…
Geometric Algebra based Embeddings for Static and Temporal Knowledge Graph Completion
Chengjin Xu, Mojtaba Nayyeri, Yung-Yu Chen +1
Recent years, Knowledge Graph Embeddings (KGEs) have shown promising performance on link prediction tasks by mapping the entities and relations from a Knowledge Graph (KG) into a g…
Faithiful Embeddings for EL++ Knowledge Bases
Bo Xiong, Nico Potyka, Trung-Kien Tran +2
Recently, increasing efforts are put into learning continual representations for symbolic knowledge bases (KBs). However, these approaches either only embed the data-level knowledg…