◍wovepaper
SearchResearchersInstitutions
Sign in
researcher

Shulun Wang

1 paper hereh-index 4140 citations5 works total

Matching runs newest-first, so older work may not be attached to this profile yet.

author position
  • first author1

Across the 1 of 1 paper where every author was matched, so the position is known.

fields
  • cs.CV1

identity via Semantic Scholar / OpenAlex

most citedEscaping the Gradient Vanishing: Periodic Alternatives of Softmax in Attention Mechanism

2 citations · 2 across the 1 of their papers we have counts for

collaborators

1 paper

cs.CV2021★ 2 cited

Escaping the Gradient Vanishing: Periodic Alternatives of Softmax in Attention Mechanism

Shulun Wang, Bin Liu, Feng Liu

Softmax is widely used in neural networks for multiclass classification, gate structure and attention mechanisms. The statistical assumption that the input is normal distributed su…

◍wovepaper

Papers, researchers and institutions, woven together.

Explore
  • Search
  • Researchers
  • Institutions
Account
  • Library
  • Chat
Data
  • arXiv.org
  • Semantic Scholar
  • OpenAlex
  • Latest RSS
AboutContactPrivacyDevelopersllms.txtopenapi.json
Not affiliated with arXiv. Researcher data from Semantic Scholar (ODC-BY) and OpenAlex.