Folded Context Condensation in Path Integral Formalism for Infinite Context Transformers

Won-Gi Paeng, Daesuk Kwon, Kyungwon Jeong +1

In this work, we present a generalized formulation of the Transformer algorithm by reinterpreting its core mechanisms within the framework of Path Integral formalism. In this persp…