5 papers
Judging by the Cover: Cleaning LLM Truthfulness Benchmarks to Avoid Surface-Level Feature Leakage
Foad Namjoo, Remy Ogasawara, Amirali Abdullah +3
Binary-choice truth benchmarks ask models to choose between a correct and an incorrect answer, but if the two answers differ systematically in surface-level features, models can ex…
Sampling for Region-Aggregated Spatial Scan Statistics
Foad Namjoo, Drew McClelland, Michael Matheny +1
Anomaly detection in geospatial data is a crucial tool in geographic information science (GIS), with applications ranging from national security to public-health surveillance to th…
Understanding and Mitigating Dataset Corruption in LLM Steering
Cullen Anderson, Narmeen Oozeer, Foad Namjoo +3
Contrastive steering has been shown as a simple and effective method to adjust the generative behavior of LLMs at inference time. It uses examples of prompt responses with and with…
Designing a Secure and Resilient Distributed Smartphone Participant Data Collection System
Foad Namjoo, Neng Wan, Devan Mallory +6
Real-world health studies require continuous and secure data collection from mobile and wearable devices. We introduce MotionPI, a smartphone-based system designed to collect behav…
Efficient and Stable Multi-Dimensional Kolmogorov-Smirnov Distance
Peter Matthew Jacobs, Foad Namjoo, Jeff M. Phillips
We revisit extending the Kolmogorov-Smirnov distance between probability distributions to the multi-dimensional setting, and make new arguments about the proper way to approach thi…