4 papers
Deep Learning Framework Testing via Model Mutation: How Far Are We?
Yanzhou Mu, Rong Wang, Juan Zhai +7
Deep Learning (DL) frameworks are a fundamental component of DL development. Therefore, the detection of DL framework defects is important and challenging. As one of the most widel…
DevMuT: Testing Deep Learning Framework via Developer Expertise-Based Mutation
Yanzhou Mu, Juan Zhai, Chunrong Fang +6
Deep learning (DL) frameworks are the fundamental infrastructure for various DL applications. Framework defects can profoundly cause disastrous accidents, thus requiring sufficient…
Improving Deep Learning Framework Testing with Model-Level Metamorphic Testing
Yanzhou Mu, Juan Zhai, Chunrong Fang +6
Deep learning (DL) frameworks are essential to DL-based software systems, and framework bugs may lead to substantial disasters, thus requiring effective testing. Researchers adopt…
An Empirical Study on Challenges for LLM Application Developers
Xiang Chen, Chaoyang Gao, Chunyang Chen +2
In recent years, large language models (LLMs) have seen rapid advancements, significantly impacting various fields such as computer vision, natural language processing, and softwar…