3 papers
cs.DC2025
How to Evaluate Distributed Coordination Systems? -- A Survey and Analysis
Bekir Turkkan, Elvis Rodrigues, Tevfik Kosar +3
Coordination services and protocols are critical components of distributed systems and are essential for providing consistency, fault tolerance, and scalability. However, due to th…
cs.SE2025
Evaluating the Energy-Efficiency of the Code Generated by LLMs
Md Arman Islam, Devi Varaprasad Jonnala, Ritika Rekhi +5
As the quality of code generated by Large Language Models (LLMs) improves, their adoption in the software industry for automated code generation continues to grow. Researchers prim…
cs.AI2025
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
Saurabh Jha, Rohan Arora, Yuji Watanabe +40
Realizing the vision of using AI agents to automate critical IT tasks depends on the ability to measure and understand effectiveness of proposed solutions. We introduce ITBench, a…