4 papers
TRACER: A Semantic-Aware Framework for Fine-Grained Contamination Detection in Code LLMs
Yifeng Di, Xuliang Huang, Tianyi Zhang
Data contamination is a known threat to the reliability of model evaluation. However, it remains underexplored in code large language models (LLMs), where contamination often goes…
Automating API Documentation from Crowdsourced Knowledge
Bonan Kou, Zijie Zhou, Muhao Chen +1
API documentation is crucial for developers to learn and use APIs. However, it is known that many official API documents are obsolete and incomplete. To address this challenge, we…
Decide: Knowledge-Based Version Incompatibility Detection in Deep Learning Stacks
Zihan Zhou, Zhongkai Zhao, Bonan Kou +1
Version incompatibility issues are prevalent when reusing or reproducing deep learning (DL) models and applications. Compared with official API documentation, which is often incomp…
Do Large Language Models Pay Similar Attention Like Human Programmers When Generating Code?
Bonan Kou, Shengmai Chen, Zhijie Wang +2
Large Language Models (LLMs) have recently been widely used for code generation. Due to the complexity and opacity of LLMs, little is known about how these models generate code. We…