5 papers
Rethinking Reverse KL as Adaptive Entropy Distillation
Shizhen Li, Zhiyu Shen, Yuyin Lu +4
Knowledge distillation (KD) is widely used to transfer the capabilities of large language models (LLMs) to smaller students, but existing objectives often struggle to balance faith…
Double-Calibration: Towards Reliable LLMs via Calibrating Knowledge and Reasoning Confidence
Yuyin Lu, Ziran Liang, Yanghui Rao +3
Reliable reasoning in Large Language Models (LLMs) is challenged by their propensity for hallucination. While augmenting LLMs with Knowledge Graphs (KGs) improves factual accuracy,…
Exploring the Paradigm Shift from Grounding to Skolemization for Complex Query Answering on Knowledge Graphs
Yuyin Lu, Hegang Chen, Shanrui Xie +4
Complex Query Answering (CQA) over incomplete Knowledge Graphs (KGs), typically formalized as reasoning with Existential First-Order predicate logic with one free variable (EFO\tex…
scE2TM improves single-cell embedding interpretability and reveals cellular perturbation signatures
Hegang Chen, Yuyin Lu, Yifan Zhao +5
Single-cell RNA sequencing technologies have revolutionized our understanding of cellular heterogeneity, yet computational methods often struggle to balance performance with biolog…
Self-supervised Topic Taxonomy Discovery in the Box Embedding Space
Yuyin Lu, Hegang Chen, Pengbo Mao +4
Topic taxonomy discovery aims at uncovering topics of different abstraction levels and constructing hierarchical relations between them. Unfortunately, most of prior work can hardl…