6 papers
Fairness Testing of Large Language Models in Role-Playing
Xinyue Li, Zhenpeng Chen, Jie M. Zhang +6
Large Language Models (LLMs) have become foundational in modern language-driven software applications, profoundly influencing daily life. A critical technique in leveraging their p…
LLMs Are Not a Silver Bullet: A Case Study on Software Fairness
Xinyue Li, Sixuan Li, Ying Xiao +4
Fairness is a critical requirement for human-related, high-stakes software systems, motivating extensive research on bias mitigation. Prior work has largely focused on tabular data…
Promptware Engineering: Software Engineering for Prompt-Enabled Systems
Zhenpeng Chen, Chong Wang, Weisong Sun +3
Large Language Models (LLMs) are increasingly integrated into software applications, giving rise to a broad class of prompt-enabled systems, in which prompts serve as the primary '…
A First Look at Bugs in LLM Inference Engines
Mugeng Liu, Siqi Zhong, Weichen Bi +5
Large language model-specific inference engines (in short as \emph{LLM inference engines}) have become a fundamental component of modern AI infrastructure, enabling the deployment…
BAMAS: Structuring Budget-Aware Multi-Agent Systems
Liming Yang, Junyu Luo, Xuanzhe Liu +2
Large language model (LLM)-based multi-agent systems have emerged as a powerful paradigm for enabling autonomous agents to solve complex tasks. As these systems scale in complexity…
FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation
Junyu Luo, Zhizhuo Kou, Liming Yang +10
Multimodal Large Language Models (MLLMs) have experienced rapid development in recent years. However, in the financial domain, there is a notable lack of effective and specialized…