On the Tensor Representation and Algebraic Homomorphism of the Neural State Turing Machine

Ankur Mali, Alexander Ororbia, Daniel Kifer +1

Recurrent neural networks (RNNs) and transformers have been shown to be Turing-complete, but this result assumes infinite precision in their hidden representations, positional enco…