61 citations · 231 across the 34 of their papers we have counts for
5 papers · 1 filter
Expanding Expressivity in Transformer Models with MöbiusAttention
Anna-Maria Halacheva, Mojtaba Nayyeri, Steffen Staab
Attention mechanisms and Transformer architectures have revolutionized Natural Language Processing (NLP) by enabling exceptional modeling of long-range dependencies and capturing i…
Ultrahyperbolic Knowledge Graph Embeddings
Bo Xiong, Shichao Zhu, Mojtaba Nayyeri +4
Recent knowledge graph (KG) embeddings have been advanced by hyperbolic geometry due to its superior capability for representing hierarchies. The topological structures of real-wor…
Motif Learning in Knowledge Graphs Using Trajectories Of Differential Equations
Mojtaba Nayyeri, Chengjin Xu, Jens Lehmann +1
Knowledge Graph Embeddings (KGEs) have shown promising performance on link prediction tasks by mapping the entities and relations from a knowledge graph into a geometric space (usu…
Knowledge Graph Embeddings in Geometric Algebras
Chengjin Xu, Mojtaba Nayyeri, Yung-Yu Chen +1
Knowledge graph (KG) embedding aims at embedding entities and relations in a KG into a lowdimensional latent representation space. Existing KG embedding approaches model entities a…
Temporal Knowledge Graph Embedding Model based on Additive Time Series Decomposition
Chengjin Xu, Mojtaba Nayyeri, Fouad Alkhoury +2
Knowledge Graph (KG) embedding has attracted more attention in recent years. Most KG embedding models learn from time-unaware triples. However, the inclusion of temporal informatio…