3 citations · 5 across the 4 of their papers we have counts for
4 papers
Command A: An Enterprise-Ready Large Language Model
Team Cohere, :, Aakanksha +227
In this report we describe the development of Command A, a powerful large language model purpose-built to excel at real-world enterprise use cases. Command A is an agent-optimised…
Procedural Knowledge in Pretraining Drives Reasoning in Large Language Models
Laura Ruis, Maximilian Mozes, Juhan Bae +7
The capabilities and limitations of Large Language Models have been sketched out in great detail in recent years, providing an intriguing yet conflicting picture. On the one hand,…
Exploring Low Rank Training of Deep Neural Networks
Siddhartha Rao Kamalakara, Acyr Locatelli, Bharat Venkitesh +3
Training deep neural networks in low rank, i.e. with factorised layers, is of particular interest to the community: it offers efficiency over unfactorised training in terms of both…
Scalable Training of Language Models using JAX pjit and TPUv4
Joanna Yoo, Kuba Perlin, Siddhartha Rao Kamalakara +1
Modern large language models require distributed training strategies due to their size. The challenges of efficiently and robustly training them are met with rapid developments on…