Beliefs in feedback: Factored representations of interacting agents in transformers

David A. Ehrlich, Manuel Baltieri, Fernando E. Rosas +1

Complex systems, from ecosystems to brains, are usually modeled as modular components coupled through feedback rather than as indivisible wholes. Can a transformer trained on the j…