Graph Memory Transformer (GMT)

Nicola Zanarini, Niccolò Ferrari, Evelina Lamma

We investigate whether an explicit learned memory graph can replace the Feed-Forward Network (FFN) sublayer in a decoder-only transformer while preserving the surrounding autoregre…