9 citations · 10 across the 2 of their papers we have counts for
2 papers
cs.LG2024★ 1 cited
Ascend HiFloat8 Format for Deep Learning
Yuanyong Luo, Zhongxing Zhang, Richard Wu +16
This preliminary white paper proposes a novel 8-bit floating-point data format HiFloat8 (abbreviated as HiF8) for deep learning. HiF8 features tapered precision. For normal value e…
cs.CV2021★ 9 cited
On the Integration of Self-Attention and Convolution
Xuran Pan, Chunjiang Ge, Rui Lu +4
Convolution and self-attention are two powerful techniques for representation learning, and they are usually considered as two peer approaches that are distinct from each other. In…