5 papers
UnWEIRDing LLM Entity Recommendations
Aayush Kumar, Sanket Mhatre
Large Language Models have been widely been adopted by users for writing tasks such as sentence completions. While this can improve writing efficiency, prior research shows that LL…
TEN: Table Explicitization, Neurosymbolically
Nikita Mehrotra, Aayush Kumar, Sumit Gulwani +2
We present a neurosymbolic approach, TEN, for extracting tabular data from semistructured input text. This task is particularly challenging for text input that does not use special…
Why AI Agents Still Need You: Findings from Developer-Agent Collaborations in the Wild
Aayush Kumar, Yasharth Bajpai, Sumit Gulwani +2
Software Engineering Agents (SWE agents) can autonomously perform development tasks on benchmarks like SWE Bench, but still face challenges when tackling complex and ambiguous real…
TableTalk: Scaffolding Spreadsheet Development with a Language Agent
Jenny T. Liang, Aayush Kumar, Yasharth Bajpai +7
Spreadsheet programming is challenging. Programmers use spreadsheet programming knowledge (e.g., formulas) and problem-solving skills to combine actions into complex tasks. Advance…
To Google or To ChatGPT? A Comparison of CS2 Students' Information Gathering Approaches and Outcomes
Aayush Kumar, Daniel Prol, Amin Alipour +1
LLMs such as ChatGPT have been widely adopted by students in higher education as tools for learning programming and related concepts. However, it remains unclear how effective stud…