4 papers
How Good Are LLMs at Processing Tool Outputs?
Kiran Kate, Yara Rizk, Poulami Ghosh +4
Most realistic task automation problems require large language models (LLMs) to call tools, which often return complex JSON responses. These responses must be further processed to…
ToolRM: Outcome Reward Models for Tool-Calling Large Language Models
Mayank Agarwal, Ibrahim Abdelaziz, Kinjal Basu +4
As large language models (LLMs) increasingly interact with external tools, reward modeling for tool use has emerged as a critical yet underexplored area of research. Existing rewar…
Assessing Engineering Student Perceptions of Introductory CS Courses in an Indian Context
Utsav Kumar Nareti, Divyansh Gupta, Chandranath Adak +5
Understanding student perceptions of assessment is vital for designing inclusive and effective learning environments, especially in technical education. This study explores enginee…
LongFuncEval: Measuring the effectiveness of long context models for function calling
Kiran Kate, Tejaswini Pedapati, Kinjal Basu +5
Multiple recent studies have documented large language models' (LLMs) performance on calling external tools/functions. Others focused on LLMs' abilities to handle longer context le…