4 papers
A Unified LLM-Adaptable Framework for Cold-Start Cognitive Diagnosis
Zihan Yao, Chentao Song, Yu He +4
Cognitive Diagnosis has become a critical task in AI-empowered education, supporting personalized learning by accurately assessing students' cognitive states. However, traditional…
Feature Learning Dynamics in Infinite-Depth Neural Networks
Zihan Yao, Ruoyu Wu, Tianxiang Gao
Deep neural networks have achieved remarkable success in practice, yet a mechanistic understanding of how features evolve during training remains incomplete, especially in the larg…
ResoFilter: Fine-grained Synthetic Data Filtering for Large Language Models through Data-Parameter Resonance Analysis
Zeao Tu, Xiangdi Meng, Yu He +4
Large language models (LLMs) have shown remarkable effectiveness across various domains, with data augmentation methods utilizing GPT for synthetic data generation becoming prevale…
Scalable Model Editing via Customized Expert Networks
Zihan Yao, Yu He, Tianyu Qi +1
Addressing the issues of hallucinations and outdated knowledge in large language models is critical for their reliable application. Model Editing presents a promising avenue for mi…