4 papers
Towards Better Code Understanding in Decoder-Only Models with Contrastive Learning
Jiayi Lin, Yanlin Wang, Yibiao Yang +2
Recent advances in large-scale code generation models have led to remarkable progress in producing high-quality code. These models are trained in a self-supervised manner on extens…
Scaling Laws Behind Code Understanding Model
Jiayi Lin, Hande Dong, Yutao Xie +1
The scaling law is becoming a fundamental law in many machine learning areas. That is, test error falls off with the power law when increasing training data, model size, and comput…
Survey of Code Search Based on Deep Learning
Yutao Xie, Jiayi Lin, Hande Dong +2
Code writing is repetitive and predictable, inspiring us to develop various code intelligence techniques. This survey focuses on code search, that is, to retrieve code that matches…
Improving Code Search with Hard Negative Sampling Based on Fine-tuning
Hande Dong, Jiayi Lin, Yanlin Wang +3
Pre-trained code models have emerged as the state-of-the-art paradigm for code search tasks. The paradigm involves pre-training the model on search-irrelevant tasks such as masked…