Showing cs.AIShow all
2 papers · 1 filter
cs.AI2025
Representing Prompting Patterns with PDL: Compliance Agent Case Study
Mandana Vaziri, Louis Mandel, Yuji Watanabe +3
Prompt engineering for LLMs remains complex, with existing frameworks either hiding complexity behind restrictive APIs or providing inflexible canned patterns that resist customiza…
cs.AI2025
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
Saurabh Jha, Rohan Arora, Yuji Watanabe +40
Realizing the vision of using AI agents to automate critical IT tasks depends on the ability to measure and understand effectiveness of proposed solutions. We introduce ITBench, a…