Showing 2024Show all
2 papers · 1 filter
cs.HC2024★ 1 cited
Prompt Adaptation as a Dynamic Complement in Generative AI Systems
Eaman Jahani, Benjamin S. Manning, Joe Zhang +5
As generative AI systems rapidly improve, a key question emerges: how do users adapt to these changes, and when does such adaptation matter for realizing performance gains? Drawing…
cs.SE2024
The RealHumanEval: Evaluating Large Language Models' Abilities to Support Programmers
Hussein Mozannar, Valerie Chen, Mohammed Alsobay +7
Evaluation of large language models for code has primarily relied on static benchmarks, including HumanEval (Chen et al., 2021), or more recently using human preferences of LLM res…