The Double Helix inside the NLP Transformer

Jason H. J. Lu, Qingzhen Guo

We introduce a framework for analyzing various types of information in an NLP Transformer. In this approach, we distinguish four layers of information: positional, syntactic, seman…