Language Re-generation: An investigation into information locality effects on reconstruction

Amirhossein Mohammadi, Laurence E. Frank, Albert Gatt +1

Information locality, the tendency for syntactically related words to appear close together, shapes both human language processing and language model learning. While prior work has…