CallScreenBench: Benchmarking Small Language Models as Phone Secretaries

Jiaqi Gan, Haoyuan Tang, Jamey Z. Liang +6

Language models small enough to run on a handset, quantized to a few bits, are increasingly capable of acting on their user's behalf -- which makes on-device task automation newly…