Large Language Models for IT Automation Tasks: Are We There Yet?

Md Mahadi Hassan, John Salvador, Akond Rahman +1

LLMs show promise in code generation, yet their effectiveness for IT automation tasks, particularly for tools like Ansible, remains understudied. Existing benchmarks rely primarily…