4 papers
MortarBench: Evaluating Mortgage Loan Origination Agents
Matthew Toles, Yunan Lu, Manav Munjal +6
Loan origination is the process by which a lender creates a new loan, from application and underwriting through approval and funding. This process serves a critical role in evaluat…
FormGym: Doing Paperwork with Agents
Matthew Toles, Rattandeep Singh, Isaac Song +1
Completing paperwork is a challenging and time-consuming problem. Form filling is especially challenging in the pure-image domain without access to OCR, typeset PDF text, or a DOM.…
Program Synthesis Dialog Agents for Interactive Decision-Making
Matthew Toles, Nikhil Balwani, Rattandeep Singh +2
Many real-world eligibility problems, ranging from medical diagnosis to tax planning, can be mapped to decision problems expressed in natural language, wherein a model must make a…
Alexpaca: Learning Factual Clarification Question Generation Without Examples
Matthew Toles, Yukun Huang, Zhou Yu +1
Real-life tasks such as giving legal or technical advice often lack complete context at the outset and can have disparate answers depending thereon. The ability to derive missing f…