◍wovepaper
SearchResearchersInstitutions
Sign in
researcher

Reza Yazdani Aminabadi

10 papers hereh-index 103.7k citations13 works total

Matching runs newest-first, so older work may not be attached to this profile yet.

author position
  • first author1
  • middle author9

Across the 10 of 10 papers where every author was matched, so the position is known.

fields
  • cs.CL4
  • cs.LG4
  • cs.DC1
  • cs.PF1

identity via Semantic Scholar / OpenAlex

activity
20212024
most citedUsing DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

299 citations · 521 across the 10 of their papers we have counts for

collaborators
Showing 2021 · cs.DCShow all

1 paper · 2 filters

cs.DC2021★ 61 cited

ZeRO-Offload: Democratizing Billion-Scale Model Training

Jie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi +5

Large-scale model training has been a playing ground for a limited few requiring complex model refactoring and access to prohibitively expensive GPU clusters. ZeRO-Offload changes…

◍wovepaper

Papers, researchers and institutions, woven together.

Explore
  • Search
  • Researchers
  • Institutions
Account
  • Library
  • Chat
Data
  • arXiv.org
  • Semantic Scholar
  • OpenAlex
  • Latest RSS
AboutContactPrivacyDevelopersllms.txtopenapi.json
Not affiliated with arXiv. Researcher data from Semantic Scholar (ODC-BY) and OpenAlex.