7 papers
Towards Apples to Apples for AI Evaluations: From Real-World Use Cases to Evaluation Scenarios
Yee-Yin Choong, Kristen Greene, Alice Qian +6
AI measurement science has a wide variety of methodologies and measurements for comparing AI systems, resulting in what often appear to be "apples-to-oranges" comparisons across AI…
Worker Discretion Advised: Co-designing Risk Disclosure in Crowdsourced Responsible AI (RAI) Content Work
Alice Qian, Ziqi Yang, Ryland Shaw +3
Responsible AI (RAI) content work, such as annotation, moderation, or red teaming for AI safety, often exposes crowd workers to potentially harmful content. While prior work has un…
Locating Risk: Task Designers and the Challenge of Risk Disclosure in RAI Content Work
Alice Qian, Ryland Shaw, Laura Dabbish +2
As AI systems are increasingly tested and deployed in open-ended and high-stakes domains, crowdworkers are often tasked with responsible AI (RAI) content work. These tasks include…
Supporting Informed Self-Disclosure: Design Recommendations for Presenting AI-Estimates of Privacy Risks to Users
Isadora Krsek, Meryl Ye, Wei Xu +3
People candidly discuss sensitive topics online under the perceived safety of anonymity; yet, for many, this perceived safety is tenuous, as miscalibrated risk perceptions can lead…
Understanding the Challenges of Maker Entrepreneurship
Natalie Friedman, Alexandra Bremers, Adelaide Nyanyo +5
The maker movement embodies a resurgence in DIY creation, merging physical craftsmanship and arts with digital technology support. However, mere technological skills and creativity…
Letters from Future Self: Augmenting the Letter-Exchange Exercise with LLM-based Agents to Enhance Young Adults' Career Exploration
Hayeon Jeon, Suhwoo Yoon, Keyeun Lee +9
Young adults often encounter challenges in career exploration. Self-guided interventions, such as the letter-exchange exercise, where participants envision and adopt the perspectiv…