MetroLLM-Bench: Evaluating Language Models as Transit Kiosk Runtimes

Remco Hendriks

We introduce MetroLLM-Bench, a 955-case benchmark for testing language models as the policy layer of a transit kiosk. It covers six real metro systems, ranging from 37 to 414 stati…