2 papers
cs.LG2025
Spectra 1.1: Scaling Laws and Efficient Inference for Ternary Language Models
Tejas Vaidhya, Ayush Kaushal, Vineet Jain +5
Large language models (LLMs) are increasingly used across research and industry applications, yet their inference efficiency remains a significant challenge. As the computational p…
cs.LG2024
Spectra: Surprising Effectiveness of Pretraining Ternary Language Models at Scale
Ayush Kaushal, Tejas Vaidhya, Arnab Kumar Mondal +3
Rapid advancements in GPU computational power has outpaced memory capacity and bandwidth growth, creating bottlenecks in Large Language Model (LLM) inference. Post-training quantiz…