Optimization Strategies for Enhancing Resource Efficiency in Transformers & Large Language Models

Tom Wallace, Naser Ezzati-Jivan, Beatrice Ombuki-Berman

Advancements in Natural Language Processing are heavily reliant on the Transformer architecture, whose improvements come at substantial resource costs due to ever-growing model siz…