4 papers
CLIF: Concept-Level Influence Functions for Transparent Bottleneck Models
Yike Sun, Mingkun Xu, Mu You +5
In recent years, the black-box nature of deep learning models has limited their application in high-stakes domains such as medical diagnosis and finance, where interpretability is…
ProofVerifier: A Scalable, Diversity-Driven Framework for Natural-Language Proof Verification
Haotong Yang, Zitong Wang, Shijia Kang +7
While large language models (LLMs) have achieved strong performance on mathematical problems with verifiable answers, many advanced problems are proof-based and require evaluating…
LiteToken: Removing Intermediate Merge Residues From BPE Tokenizers
Yike Sun, Haotong Yang, Zhouchen Lin +1
Tokenization is fundamental to how language models represent and process text, yet the behavior of widely used BPE tokenizers has received far less study than model architectures a…
Rapidly Developing High-quality Instruction Data and Evaluation Benchmark for Large Language Models with Minimal Human Effort: A Case Study on Japanese
Yikun Sun, Zhen Wan, Nobuhiro Ueda +4
The creation of instruction data and evaluation benchmarks for serving Large language models often involves enormous human annotation. This issue becomes particularly pronounced wh…