2 papers
cs.IR2024
Enhancing Question Answering Precision with Optimized Vector Retrieval and Instructions
Lixiao Yang, Mengyang Xu, Weimao Ke
Question-answering (QA) is an important application of Information Retrieval (IR) and language models, and the latest trend is toward pre-trained large neural networks with embeddi…
cs.CL2024
Investigating the Synergistic Effects of Dropout and Residual Connections on Language Model Training
Qingyang Li, Weimao Ke
This paper examines the pivotal role of dropout techniques in mitigating overfitting in language model training. It conducts a comprehensive investigation into the influence of var…