MonitrLLM: A Community-Centered Evaluation Infrastructure for Large Language Models

Victor Ojewale, Ro Encarnación, Suresh Venkatasubramanian +1

Benchmark suites assess model capability on controlled tasks; large-scale conversation corpora capture naturalistic use without user feedback; and in-interface feedback mechanisms…