4 papers
Evaluating the Reversal Curse in Model Editing
Hao-Xiang Xu, Jun-Yu Ma, Zhen-Hua Ling +3
Large language models (LLMs) are prone to hallucinate unintended text due to false or outdated knowledge. Since retraining LLMs is resource intensive, there has been a growing inte…
Neurosymbolic LoRA: Why and When to Tune Weights vs. Rewrite Prompts
Kevin Wang, Neel P. Bhatt, Cong Liu +7
Large language models (LLMs) can be adapted either through numerical updates that alter model parameters or symbolic manipulations that work on discrete prompts or logical constrai…
Spark-Prover-X1: Formal Theorem Proving Through Diverse Data Training
Xinyuan Zhou, Yi Lei, Xiaoyu Zhou +7
Large Language Models (LLMs) have shown significant promise in automated theorem proving, yet progress is often constrained by the scarcity of diverse and high-quality formal langu…
TACOS: Open Tagging and Comparative Scoring for Instruction Fine-Tuning Data Selection
Xixiang He, Hao Yu, Qiyao Sun +4
Instruction Fine-Tuning (IFT) is crucial for aligning large language models (LLMs) with human preferences, and selecting a small yet representative subset from massive data signifi…