6 papers
Data-aware Static Analysis: Improving Detection of Semantic Faults in Machine Learning Code Using Data Characteristics
Willem Meijer, Kristian Sandahl, Dániel Varró
Semantic faults specific to the use of machine learning models are a common problem for machine learning developers, causing suboptimal predictions, high computational cost, or inc…
Are We Lost in the Woods? Detecting Silent Semantic Faults for Random Forest Classifiers with Data-informed Static Analysis
Willem Meijer, Louis Ohl, Kristian Sandahl +1
While machine learning (ML) software necessitates effective quality assurance, ML engineers still encounter silent semantic faults, such as imbalanced datasets, that degrade predic…
JunoBench: A Benchmark Dataset of Crashes in Python Machine Learning Jupyter Notebooks
Yiran Wang, José Antonio Hernández López, José Antonio Hernández López +3
Jupyter notebooks are widely used for machine learning (ML) prototyping. Yet, few debugging tools are designed for ML code in notebooks, partly, due to the lack of benchmarks. We i…
CRANE-LLM: Runtime-Augmented LLMs for Crash Prediction and Diagnosis in ML Notebooks
Yiran Wang, José Antonio Hernández López, José Antonio Hernández López +3
Jupyter notebooks have become popular for early machine learning (ML) development, enabling interactive and iterative experimentation. However, ML notebooks are prone to bugs, amon…
Hierarchical Evaluation of Software Design Capabilities of Large Language Models of Code
Mootez Saad, Boqi Chen, José Antonio Hernández López +2
Large language models (LLMs) are being increasingly adopted in the software engineering domain, yet the robustness of their grasp on core software design concepts remains unclear.…
SeBERTis: A Framework for Producing Classifiers of Security-Related Issue Reports
Sogol Masoumzadeh, Yufei Li, Shane McIntosh +2
Monitoring issue tracker submissions is a crucial software maintenance activity. A key goal is the prioritization of high risk, security-related bugs. If such bugs can be recognize…