2 citations · 3 across the 4 of their papers we have counts for
4 papers
Decomposing Global AUC into Cluster-Level Contributions for Localized Model Diagnostics
Agus Sudjianto, Alice J. Liu
The Area Under the ROC Curve (AUC) is a widely used performance metric for binary classifiers. However, as a global ranking statistic, the AUC aggregates model behavior over the en…
Human-Calibrated Automated Testing and Validation of Generative Language Models
Agus Sudjianto, Aijun Zhang, Srinivas Neppalli +2
This paper introduces a comprehensive framework for the evaluation and validation of generative language models (GLMs), with a focus on Retrieval-Augmented Generation (RAG) systems…
Towards a framework on tabular synthetic data generation: a minimalist approach: theory, use cases, and limitations
Yueyang Shen, Agus Sudjianto, Arun Prakash R +5
We propose and study a minimalist approach towards synthetic tabular data generation. The model consists of a minimalistic unsupervised SparsePCA encoder (with contingent clusterin…
Model Validation Practice in Banking: A Structured Approach for Predictive Models
Agus Sudjianto, Aijun Zhang
This paper presents a comprehensive overview of model validation practices and advancement in the banking industry based on the experience of managing Model Risk Management (MRM) s…