From the 1 of 19 linked papers with an AI index.
4 papers · 1 filter
AdaMTP: An Adaptive Training Paradigm for Multi-Token Prediction
Ziqiang Cui, Han Shi, Bowei He +8
Multi-Token Prediction (MTP) has emerged as an effective paradigm that augments a shared Large Language Model backbone with auxiliary heads, training the model to predict several f…
Less Is More: Elevating RAG via Performance-Driven Context Compression
Ziqiang Cui, Yunpeng Weng, Xing Tang +7
Retrieval-Augmented Generation (RAG) has emerged as a promising paradigm for improving the timeliness of knowledge updates and the factual accuracy of large language models. Howeve…
RECODE-H: A Benchmark for Research Code Development with Interactive Human Feedback
Chunyu Miao, Henry Peng Zou, Yangning Li +28
Large language models (LLMs) show the promise in supporting scientific research implementation, yet their ability to generate correct and executable code remains limited. Existing…
NILE: Internal Consistency Alignment in Large Language Models
Minda Hu, Qiyuan Zhang, Yufei Wang +7
As a crucial step to enhance LLMs alignment with human intentions, Instruction Fine-Tuning (IFT) has a high demand on dataset quality. However, existing IFT datasets often contain…