Credit Cards, Confusion, Computation, and Consequences: What Can We Uncover About Language Model Reasoning?

Arnav Hiray, Agam Shah, Caleb Lu +3

We introduce CreditCardQA, the first financial literacy benchmark for numerical reasoning derived from real credit card agreements. The dataset contains 1,800 questions, including…