Partial Tensorized Transformers for Natural Language Processing

Subhadra Vadlamannati, Ryan Solgi

The transformer architecture has revolutionized Natural Language Processing (NLP) and other machine-learning tasks, due to its unprecedented accuracy. However, their extensive memo…