99 citations · 111 across the 10 of their papers we have counts for
4 papers · 1 filter
PLDiv: Measuring Dataset Diversity and Semantic Collapse via Persistence Landscapes
Yang Ba, Michelle V. Mancenido, Rong Pan
Modern data pipelines increasingly combine human-created and human-curated data with AI-generated data for model training and evaluation. As datasets grow, they often add semantica…
Can We Trust This Evaluation? Instance-Level Reliability of LLM-as-a-Judge
Yang Ba, Michelle V. Mancenido, Rong Pan
LLM-as-a-judge evaluation commonly aggregates multiple judges' decisions into a majority vote, yet this panel decision process does not guarantee that the evaluation of an individu…
Training-Aware Target Coverage for Synthetic Data Selection
Yang Ba, Michelle V. Mancenido, Rong Pan
Synthetic data are increasingly used to scale LLM training, yet more synthetic data do not necessarily produce better models. Useful synthetic data must add information relevant to…
Measuring Dataset Diversity from a Geometric Perspective
Yang Ba, Mohammad Sadeq Abolhasani, Michelle V Mancenido +1
Diversity can be broadly defined as the presence of meaningful variation across elements, which can be viewed from multiple perspectives, including statistical variation and geomet…