28 citations · 72 across the 11 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CV2022★ 8 cited
Number of Attention Heads vs Number of Transformer-Encoders in Computer Vision
Tomas Hrycej, Bernhard Bermeitinger, Siegfried Handschuh
Determining an appropriate number of attention heads on one hand and the number of transformer-encoders, on the other hand, is an important choice for Computer Vision (CV) tasks us…
cs.LG2022★ 2 cited
Training Neural Networks in Single vs Double Precision
Tomas Hrycej, Bernhard Bermeitinger, Siegfried Handschuh
The commitment to single-precision floating-point arithmetic is widespread in the deep learning community. To evaluate whether this commitment is justified, the influence of comput…