17 citations · 23 across the 14 of their papers we have counts for
16 papers · 1 filter
Tangent: An Empirical Study of Testing Practices for LLM-Based Agent Applications
Rangeet Pan, Tyler Stennett, Divya Sankar +5
Agents built on large language models (LLMs) are increasingly used to build applications that perform complex, multi-step tasks involving reasoning, tool use, and interaction with…
AutoRestTest at the SBFT 2026 Tool Competition
Tyler Stennett, Myeongsoo Kim, Saurabh Sinha +1
Large input spaces and complex inter-operation dependencies make black-box REST API testing challenging. AutoRestTest combines a Semantic Property Dependency Graph, multi-agent rei…
Sakura: An Approach for Generating Complex Tests from Natural Language Test Descriptions
Tyler Stennett, Rangeet Pan, Bridget McGinn +2
Research on automating software testing has spanned several decades. Most existing approaches generate unit tests for individual methods, validate isolated API endpoints, or target…
MockingBird: Context-aware Repository-level Code Translation with Isolated Validation
Kaiyao Ke, Ali Reza Ibrahimzada, Rangeet Pan +2
Despite advances in repository-level code translation, automated type resolution across differing type systems and translation validation (functional-equivalence checking) remain c…
SAINT: Service-level Integration Test Generation with Program Analysis and LLM-based Agents
Rangeet Pan, Raju Pavuluri, Ruikai Huang +4
Enterprise applications are typically tested at multiple levels, with service-level testing playing an important role in validating application functionality. Existing service-leve…
Hamster: A Large-Scale Study and Characterization of Developer-Written Tests
Rangeet Pan, Tyler Stennett, Raju Pavuluri +3
Automated test generation (ATG), which aims to reduce the cost of manual test suite development, has been investigated for decades and has produced countless techniques based on a…
AutoRestTest: A Tool for Automated REST API Testing Using LLMs and MARL
Tyler Stennett, Myeongsoo Kim, Saurabh Sinha +1
As REST APIs have become widespread in modern web services, comprehensive testing of these APIs is increasingly crucial. Because of the vast search space of operations, parameters,…
Otter: Generating Tests from Issues to Validate SWE Patches
Toufique Ahmed, Jatin Ganhotra, Rangeet Pan +3
While there has been plenty of work on generating tests from existing code, there has been limited work on generating tests from issues. A correct test must validate the code patch…
LlamaRestTest: Effective REST API Testing with Small Language Models
Myeongsoo Kim, Saurabh Sinha, Alessandro Orso
Modern web services rely heavily on REST APIs, typically documented using the OpenAPI specification. The widespread adoption of this standard has resulted in the development of man…
TDD-Bench Verified: Can LLMs Generate Tests for Issues Before They Get Resolved?
Toufique Ahmed, Martin Hirzel, Rangeet Pan +2
Test-driven development (TDD) is the practice of writing tests first and coding later, and the proponents of TDD expound its numerous benefits. For instance, given an issue on a so…
A Multi-Agent Approach for REST API Testing with Semantic Graphs and LLM-Driven Inputs
Myeongsoo Kim, Tyler Stennett, Saurabh Sinha +1
As modern web services increasingly rely on REST APIs, their thorough testing has become crucial. Furthermore, the advent of REST API documentation languages, such as the OpenAPI S…
Codellm-Devkit: A Framework for Contextualizing Code LLMs with Program Analysis Insights
Rahul Krishna, Rangeet Pan, Raju Pavuluri +3
Large Language Models for Code (or code LLMs) are increasingly gaining popularity and capabilities, offering a wide array of functionalities such as code completion, code generatio…
AlphaTrans: A Neuro-Symbolic Compositional Approach for Repository-Level Code Translation and Validation
Ali Reza Ibrahimzada, Kaiyao Ke, Mrigank Pawagi +4
Code translation transforms programs from one programming language (PL) to another. Several rule-based transpilers have been designed to automate code translation between different…
ASTER: Natural and Multi-language Unit Test Generation with LLMs
Rangeet Pan, Myeongsoo Kim, Rahul Krishna +2
Implementing automated unit tests is an important but time-consuming activity in software development. To assist developers in this task, many techniques for automating unit test g…
Leveraging Large Language Models to Improve REST API Testing
Myeongsoo Kim, Tyler Stennett, Dhruv Shah +2
The widespread adoption of REST APIs, coupled with their growing complexity and size, has led to the need for automated REST API testing tools. Current tools focus on the structure…
Adaptive REST API Testing with Reinforcement Learning
Myeongsoo Kim, Saurabh Sinha, Alessandro Orso
Modern web services increasingly rely on REST APIs. Effectively testing these APIs is challenging due to the vast search space to be explored, which involves selecting API operatio…