5 papers · 1 filter
Scaling Competence, Shrinking Reasoning: Cognitive Signatures in Language Model Learning
Mukul Singh, Ananya Singha, Arjun Radhakrishna +1
We analyze reasoning in language models during task-specific fine-tuning and draws parallel between reasoning tokens--intermediate steps generated while solving problem and the hum…
ConDABench: Interactive Evaluation of Language Models for Data Analysis
Avik Dutta, Priyanshu Gupta, Hosein Hasanbeig +6
Real-world data analysis tasks often come with under-specified goals and unclean data. User interaction is necessary to understand and disambiguate a user's intent, and hence, esse…
TEN: Table Explicitization, Neurosymbolically
Nikita Mehrotra, Aayush Kumar, Sumit Gulwani +2
We present a neurosymbolic approach, TEN, for extracting tabular data from semistructured input text. This task is particularly challenging for text input that does not use special…
Ordered Semantically Diverse Sampling for Textual Data
Ashish Tiwari, Mukul Singh, Ananya Singha +1
The goal of diversity sampling is to select a representative subset of data in a way that maximizes information contained in the subset while keeping its cardinality small. We intr…
MetaReflection: Learning Instructions for Language Agents using Past Reflections
Priyanshu Gupta, Shashank Kirtania, Ananya Singha +4
The popularity of Large Language Models (LLMs) have unleashed a new age ofLanguage Agents for solving a diverse range of tasks. While contemporary frontier LLMs are capable enough…