◍wovepaper
SearchResearchersInstitutions
Sign in
researcher

Reza Yazdani Aminabadi

10 papers hereh-index 103.7k citations13 works total

Matching runs newest-first, so older work may not be attached to this profile yet.

author position
  • first author1
  • middle author9

Across the 10 of 10 papers where every author was matched, so the position is known.

fields
  • cs.CL4
  • cs.LG4
  • cs.DC1
  • cs.PF1

identity via Semantic Scholar / OpenAlex

activity
20212024
most citedUsing DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

299 citations · 521 across the 10 of their papers we have counts for

collaborators
Showing 2023 · cs.CLShow all

2 papers · 2 filters

cs.CL2023★ 1 cited

ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6-Centric Strategy for Diverse Generative Tasks

Xiaoxia Wu, Haojun Xia, Stephen Youn +9

This study examines 4-bit quantization methods like GPTQ in large language models (LLMs), highlighting GPTQ's overfitting and limited enhancement in Zero-Shot tasks. While prior wo…

cs.CL2023★ 6 cited

Understanding INT4 Quantization for Transformer Models: Latency Speedup, Composability, and Failure Cases

Xiaoxia Wu, Cheng Li, Reza Yazdani Aminabadi +2

Improving the deployment efficiency of transformer-based language models has been challenging given their high computation and memory cost. While INT8 quantization has recently bee…

◍wovepaper

Papers, researchers and institutions, woven together.

Explore
  • Search
  • Researchers
  • Institutions
Account
  • Library
  • Chat
Data
  • arXiv.org
  • Semantic Scholar
  • OpenAlex
  • Latest RSS
AboutContactPrivacyDevelopersllms.txtopenapi.json
Not affiliated with arXiv. Researcher data from Semantic Scholar (ODC-BY) and OpenAlex.