2 papers
cs.DC2026
HexiSeq: Accommodating Long Context Training of LLMs over Heterogeneous Hardware
Yan Liang, Youhe Jiang, Ran Yan +3
Long-context training of large language models (LLMs) is commonly distributed with Context Parallelism (CP) and Head Parallelism (HP), but existing training systems largely assume…
cs.AI2023
Concept2Box: Joint Geometric Embeddings for Learning Two-View Knowledge Graphs
Zijie Huang, Daheng Wang, Binxuan Huang +8
Knowledge graph embeddings (KGE) have been extensively studied to embed large-scale relational data for many real-world applications. Existing methods have long ignored the fact ma…