Transformers know more than they can tell -- Learning the Collatz sequence

François Charton, Ashvni Narayanan

We investigate transformer prediction of long Collatz steps, a complex arithmetic function that maps odd integers to their distant successors in the Collatz sequence ( $u_{n+1}=u_n…