11 citations · 52 across the 54 of their papers we have counts for
56 papers
Learning Submanifolds for Subsequent Inference on Random Dot Product Graphs, Part 1: Theory
Michael W. Trosset, Carey E. Priebe
We propose a framework for restricted inference on random dot product graphs whose latent positions lie on an unknown low-dimensional support manifold. For general decision problem…
Query-efficient model evaluation using cached responses
Hayden Helm, Ben Johnson, Carey Priebe
Evaluating a new model on an existing benchmark is often necessary to understand its behavior before deployment. For modern evaluation frameworks, generating and evaluating a respo…
When prompt perturbations break your A/B test: A valid statistical test for generative surveying
Hayden Helm, Carey Priebe
Generative surveying -- where collections of LLM-based personas provide feedback on messages -- has emerged as a cheap and scalable alternative to traditional market research. Howe…
Control Charts for Multi-agent Systems
Hayden Helm, Carey Priebe, Brandon Duderstadt
Generative agents have proven to be powerful assistants in a wide variety of contexts. Given this success, users are now deploying agents with minimal restrictions in open ended, m…
Black-box model classification under the discriminative factorization
Hayden Helm, Merrick Ohata, Carey Priebe
Access to modern generative systems is often restricted to querying an API (the ``black-box" setting) and many properties of the system are unknown to the user at inference time. W…
Recovering manifold structure in LLM responses through a joint Euclidean mirror
Maximilian Baum, Aranyak Acharyya, Tianyi Chen +5
Understanding the behavior of black-box large language models and determining effective means of comparing their performance is a key task in modern machine learning. We consider h…