5 papers
Can Open-Weight LLMs Produce Kernel-Verified Coq Proofs? A Pilot Study
Ahmed Ryan, Md Erfan, Akond Ashfaque Ur Rahman +1
Large language models (LLMs) can generate text that resembles a mathematical proof, but resemblance does not establish correctness. A formal proof checker verifies whether each pro…
An Evaluation of Large Language Models for Detection of Malicious Python Packages
Ahmed Ryan, Ibrahim Khalil, Abdullah Al Jahid +4
Modern software development relies on open-source package repositories. Attackers use these to distribute malicious packages. Large Language Models (LLMs) can automatically detect…
Unveiling Malicious Logic: Towards a Statement-Level Taxonomy and Dataset for Securing Python Packages
Ahmed Ryan, Junaid Mansur Ifti, Md Erfan +2
The widespread adoption of open-source ecosystems enables developers to integrate third-party packages, but also exposes them to malicious packages crafted to execute harmful behav…
Large Language Models for IT Automation Tasks: Are We There Yet?
Md Mahadi Hassan, John Salvador, Akond Rahman +1
LLMs show promise in code generation, yet their effectiveness for IT automation tasks, particularly for tools like Ansible, remains understudied. Existing benchmarks rely primarily…
Using AI Assistants in Software Development: A Qualitative Study on Security Practices and Concerns
Jan H. Klemmer, Stefan Albert Horstmann, Nikhil Patnaik +10
Following the recent release of AI assistants, such as OpenAI's ChatGPT and GitHub Copilot, the software industry quickly utilized these tools for software development tasks, e.g.,…