Sequential Enumeration in Large Language Models

Kuinan Hou, Marco Zorzi, Alberto Testolin

Reliably counting and generating sequences of items remain a significant challenge for neural networks, including Large Language Models (LLMs). Indeed, although this capability is…