17 citations · 18 across the 4 of their papers we have counts for
4 papers
ResBM: Residual Bottleneck Models for Low-Bandwidth Pipeline Parallelism
Alan Aboudib, Rodrigo Lopez Portillo A., Kalei Brady +1
Unlocking large-scale low-bandwidth decentralized training has the potential to utilize otherwise untapped compute resources. In centralized settings, large-scale multi-node traini…
Incentivised Orchestrated Training Architecture (IOTA): A Technical Primer for Release
Felix Quinque, Alan Aboudib, Szymon Fonau +3
In August 2024, Bittensor's Subnet 9 (SN9) demonstrated that a distributed network of incentivized, permissionless actors could each pretrain large language models (LLMs) ranging f…
Syft 0.5: A Platform for Universally Deployable Structured Transparency
Adam James Hall, Madhava Jay, Tudor Cebere +20
We present Syft 0.5, a general-purpose framework that combines a core group of privacy-enhancing technologies that facilitate a universal set of structured transparency systems. Th…
A study of retrieval algorithms of sparse messages in networks of neural cliques
Ala Aboudib, Vincent Gripon, Xiaoran Jiang
Associative memories are data structures addressed using part of the content rather than an index. They offer good fault reliability and biological plausibility. Among different fa…