SyntaxBench: A Statistical Diagnostic Framework for Character-Level Reasoning in Large Language Models

Mohsen Larni, Sobhan Ebrahimi Azar, Pouyan Nahed +1

Large language models are increasingly used where small syntactic errors matter, yet character-level reasoning is still evaluated mostly through isolated probes and aggregate accur…