7 citations · 10 across the 7 of their papers we have counts for
7 papers
Evaluating using Mock Tool Calls to Quarantine Untrusted Prompt Inputs
David Gros, Adam Gleave
Large language models must frequently process untrusted inputs, such as judging an answer from another model or running tasks like spam and harm classifiers while under adversarial…
Calibration and Correctness of Language Models for Code
Claudio Spiess, David Gros, Kunal Suresh Pai +6
Machine learning models are widely used, but can also often be wrong. Users would benefit from a reliable indication of whether a given output from a given model should be trusted,…
AI Safety Subproblems for Software Engineering Researchers
David Gros, Prem Devanbu, Zhou Yu
In this 4-page manuscript we discuss the problem of long-term AI Safety from a Software Engineering (SE) research viewpoint. We briefly summarize long-term AI Safety, and the chall…
Robots-Dont-Cry: Understanding Falsely Anthropomorphic Utterances in Dialog Systems
David Gros, Yu Li, Zhou Yu
Dialog systems are often designed or trained to output human-like responses. However, some responses may be impossible for a machine to truthfully say (e.g. "that movie made me cry…
The R-U-A-Robot Dataset: Helping Avoid Chatbot Deception by Detecting User Questions About Human or Non-Human Identity
David Gros, Yu Li, Zhou Yu
Humans are increasingly interacting with machines through language, sometimes in contexts where the user may not know they are talking to a machine (like over the phone or a text c…
NeurIPS 2020 NLC2CMD Competition: Translating Natural Language to Bash Commands
Mayank Agarwal, Tathagata Chakraborti, Quchen Fu +6
The NLC2CMD Competition hosted at NeurIPS 2020 aimed to bring the power of natural language processing to the command line. Participants were tasked with building models that can t…
Code to Comment "Translation": Data, Metrics, Baselining & Evaluation
David Gros, Hariharan Sezhiyan, Prem Devanbu +1
The relationship of comments to code, and in particular, the task of generating useful comments given the code, has long been of interest. The earliest approaches have been based o…