15 papers
GT-SVJ: Generative-Transformer-Based Self-Supervised Video Judge For Efficient Video Reward Modeling
Shivanshu Shekhar, Uttaran Bhattacharya, Raghavendra Addanki +3
Aligning video generative models with human preferences remains challenging: current approaches rely on Vision-Language Models (VLMs) for reward modeling, but these models struggle…
Rethinking Failure Attribution in Multi-Agent Systems: A Multi-Perspective Benchmark and Evaluation
Yeonjun In, Mehrab Tanjim, Jayakumar Subramanian +6
Failure attribution is essential for diagnosing and improving multi-agent systems (MAS), yet existing benchmarks and methods largely assume a single deterministic root cause for ea…
Identity-Robust Language Model Generation via Content Integrity Preservation
Miao Zhang, Kelly Chen, Md Mehrab Tanjim +1
Large Language Model (LLM) outputs often vary across user sociodemographic attributes, leading to disparities in factual accuracy, utility, and safety, even for objective questions…
Is Safety Standard Same for Everyone? User-Specific Safety Evaluation of Large Language Models
Yeonjun In, Wonjoong Kim, Kanghoon Yoon +5
As the use of large language model (LLM) agents continues to grow, their safety vulnerabilities have become increasingly evident. Extensive benchmarks evaluate various aspects of L…
X-Reflect: Cross-Reflection Prompting for Multimodal Recommendation
Hanjia Lyu, Ryan Rossi, Xiang Chen +4
Large Language Models (LLMs) have been shown to enhance the effectiveness of enriching item descriptions, thereby improving the accuracy of recommendation systems. However, most ex…
GUI Agents: A Survey
Dang Nguyen, Jian Chen, Yu Wang +27
Graphical User Interface (GUI) agents, powered by Large Foundation Models, have emerged as a transformative approach to automating human-computer interaction. These agents autonomo…