works on
large language models 1low-rank factorization 1scaling laws 1spectral normalization 1training stability 1

From the 2 of 28 linked papers with an AI index.

activity
20242026
collaborators
Showing cs.DCShow all

1 paper · 1 filter

cs.DC2026

Covenant-72B: Pre-Training a 72B LLM with Trustless Peers Over-the-Internet

Joel Lidin, Amir Sarfi, Erfan Miahi +6

Recently, there has been increased interest in globally distributed training, which has the promise to both reduce training costs and democratize participation in building large-sc…