4 papers
CornerCase: Automated Extremal Testing of Protocol Implementations using LLMs
Rathin Singha, Kuan Qian, Srinath Saikrishnan +6
Many software bugs in network protocol implementations arise near specification boundaries, such as inputs just within or outside allowed ranges, or messages that are valid in isol…
LLM-Based Config Synthesis requires Disambiguation
Rajdeep Mondal, Nikolaj Bjorner, Todd Millstein +2
Beyond hallucinations, another problem in program synthesis using LLMs is ambiguity in user intent. We illustrate the ambiguity problem in a networking context for LLM-based increm…
Extremal Testing for Network Software using LLMs
Rathin Singha, Harry Qian, Srinath Saikrishnan +4
Physicists often manually consider extreme cases when testing a theory. In this paper, we show how to automate extremal testing of network software using LLMs in two steps: first,…
Eywa: Automating Model Based Testing using LLMs
Rajdeep Mondal, Rathin Singha, Todd Millstein +3
Model-based testing (MBT), whereby a model of the system under test is analyzed to generate high-coverage test cases, has been used to test protocol implementations. A key barrier…