19 citations · 61 across the 20 of their papers we have counts for
7 papers · 1 filter
MM-Eval: A Hierarchical Benchmark for Modern Mongolian Evaluation in LLMs
Mengyuan Zhang, Ruihui Wang, Bo Xia +2
Large language models (LLMs) excel in high-resource languages but face notable challenges in low-resource languages like Mongolian. This paper addresses these challenges by categor…
Evaluation-Driven Development and Operations of LLM Agents: A Process Model and Reference Architecture
Boming Xia, Qinghua Lu, Liming Zhu +3
Large Language Models (LLMs) have enabled the emergence of LLM agents, systems capable of pursuing under-specified goals and adapting after deployment. Evaluating such agents is ch…
Achieving Responsible AI through ESG: Insights and Recommendations from Industry Engagement
Harsha Perera, Sung Une Lee, Yue Liu +5
As Artificial Intelligence (AI) becomes integral to business operations, integrating Responsible AI (RAI) within Environmental, Social, and Governance (ESG) frameworks is essential…
Blockchain-Enabled Accountability in Data Supply Chain: A Data Bill of Materials Approach
Yue Liu, Dawen Zhang, Boming Xia +4
In the era of advanced artificial intelligence, highlighted by large-scale generative models like GPT-4, ensuring the traceability, verifiability, and reproducibility of datasets t…
Integrating ESG and AI: A Comprehensive Responsible AI Assessment Framework
Sung Une Lee, Harsha Perera, Yue Liu +5
Artificial Intelligence (AI) is a widely developed and adopted technology across entire industry sectors. Integrating environmental, social, and governance (ESG) considerations wit…
Responsible AI Question Bank: A Comprehensive Tool for AI Risk Assessment
Sung Une Lee, Harsha Perera, Yue Liu +5
The rapid growth of Artificial Intelligence (AI) has underscored the urgent need for responsible AI practices. Despite increasing interest, a comprehensive AI risk assessment toolk…
An AI System Evaluation Framework for Advancing AI Safety: Terminology, Taxonomy, Lifecycle Mapping
Boming Xia, Qinghua Lu, Liming Zhu +1
The advent of advanced AI underscores the urgent need for comprehensive safety evaluations, necessitating collaboration across communities (i.e., AI, software engineering, and gove…