1 citations · 1 across the 4 of their papers we have counts for
4 papers
FoundationLayerNorm: Scaling BERT and GPT to 1,000 Layers
Dezhou Shen
The mainstream BERT/GPT model contains only 10 to 20 layers, and there is little literature to discuss the training of deep BERT/GPT. This paper proposes a simple yet effective met…
FPM: A Collection of Large-scale Foundation Pre-trained Language Models
Dezhou Shen
Large-scale Transformer models have significantly promoted the recent development of natural language processing applications. However, little effort has been made to unify the eff…
Movie Box office Prediction via Joint Actor Representations and Social Media Sentiment
Dezhou Shen
In recent years, driven by the Asian film industry, such as China and India, the global box office has maintained a steady growth trend. Previous studies have rarely used long-term…
Lower Bounds on Rate of Convergence of Matrix Products in All Pairs Shortest Path of Social Network
Dezhou Shen
With the rapid development of social network applications, social network has become an important medium for people to interact. For the minimum distance computation of all pairs i…