257 citations · 1.2k across the 74 of their papers we have counts for
4 papers · 1 filter
GT2Vec: Large Language Models as Multi-Modal Encoders for Text and Graph-Structured Data
Jiacheng Lin, Kun Qian, Haoyu Han +9
Graph-structured information offers rich contextual information that can enhance language models by providing structured relationships and hierarchies, leading to more expressive e…
Multi-Stage Balanced Distillation: Addressing Long-Tail Challenges in Sequence-Level Knowledge Distillation
Yuhang Zhou, Jing Zhu, Paiheng Xu +5
Large language models (LLMs) have significantly advanced various natural language processing tasks, but deploying them remains computationally expensive. Knowledge distillation (KD…
Relational World Knowledge Representation in Contextual Language Models: A Review
Tara Safavi, Danai Koutra
Relational knowledge bases (KBs) are commonly used to represent world knowledge in machines. However, while advantageous for their high degree of precision and interpretability, KB…
CoDEx: A Comprehensive Knowledge Graph Completion Benchmark
Tara Safavi, Danai Koutra
We present CoDEx, a set of knowledge graph completion datasets extracted from Wikidata and Wikipedia that improve upon existing knowledge graph completion benchmarks in scope and l…