◍wovepaper
SearchResearchersInstitutions
Sign in
researcher

Reza Yazdani Aminabadi

10 papers hereh-index 103.7k citations13 works total

Matching runs newest-first, so older work may not be attached to this profile yet.

author position
  • first author1
  • middle author9

Across the 10 of 10 papers where every author was matched, so the position is known.

fields
  • cs.CL4
  • cs.LG4
  • cs.DC1
  • cs.PF1

identity via Semantic Scholar / OpenAlex

activity
20212024
most citedUsing DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

299 citations · 521 across the 10 of their papers we have counts for

collaborators
Showing 2022 · cs.LGShow all

2 papers · 2 filters

cs.LG2022★ 8 cited

DeepSpeed Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale

Reza Yazdani Aminabadi, Samyam Rajbhandari, Minjia Zhang +8

The past several years have witnessed the success of transformer-based models, and their scale and application scenarios continue to grow aggressively. The current landscape of tra…

cs.LG2022★ 56 cited

DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale

Samyam Rajbhandari, Conglong Li, Zhewei Yao +5

As the training of giant dense models hits the boundary on the availability and capability of the hardware resources today, Mixture-of-Experts (MoE) models become one of the most p…

◍wovepaper

Papers, researchers and institutions, woven together.

Explore
  • Search
  • Researchers
  • Institutions
Account
  • Library
  • Chat
Data
  • arXiv.org
  • Semantic Scholar
  • OpenAlex
  • Latest RSS
AboutContactPrivacyDevelopersllms.txtopenapi.json
Not affiliated with arXiv. Researcher data from Semantic Scholar (ODC-BY) and OpenAlex.