Towards smaller, faster decoder-only transformers: Architectural variants and their implications

Sathya Krishnan Suresh, Shunmugapriya P

In recent times, the research on Large Language Models (LLMs) has grown exponentially, predominantly focusing on models underpinned by the transformer architecture, as established…