2 citations · 6 across the 5 of their papers we have counts for
5 papers
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
Saurabh Jha, Rohan Arora, Yuji Watanabe +40
Realizing the vision of using AI agents to automate critical IT tasks depends on the ability to measure and understand effectiveness of proposed solutions. We introduce ITBench, a…
Adaptive PII Mitigation Framework for Large Language Models
Shubhi Asthana, Ruchi Mahindru, Bing Zhang +1
Artificial Intelligence (AI) faces growing challenges from evolving data protection laws and enforcement practices worldwide. Regulations like GDPR and CCPA impose strict complianc…
Deploying Privacy Guardrails for LLMs: A Comparative Analysis of Real-World Applications
Shubhi Asthana, Bing Zhang, Ruchi Mahindru +3
The adoption of Large Language Models (LLMs) has revolutionized AI applications but poses significant challenges in safeguarding user privacy. Ensuring compliance with privacy regu…
ScriptSmith: A Unified LLM Framework for Enhancing IT Operations via Automated Bash Script Generation, Assessment, and Refinement
Oishik Chatterjee, Pooja Aggarwal, Suranjana Samanta +8
In the rapidly evolving landscape of site reliability engineering (SRE), the demand for efficient and effective solutions to manage and resolve issues in site and cloud application…
Retrieval Augmented Generation-Based Incident Resolution Recommendation System for IT Support
Paulina Toro Isaza, Michael Nidd, Noah Zheutlin +7
Clients wishing to implement generative AI in the domain of IT Support and AIOps face two critical issues: domain coverage and model size constraints due to model choice limitation…