activity
20182022
most citedFP8 Formats for Deep Learning

50 citations · 79 across the 5 of their papers we have counts for

collaborators

5 papers

cs.LG2022★ 50 cited

FP8 Formats for Deep Learning

Paulius Micikevicius, Dusan Stosic, Neil Burgess +12

FP8 is a natural progression for accelerating deep learning training inference beyond the 16-bit formats common in modern processors. In this paper we propose an 8-bit floating poi…

cs.LG2021

An Underexplored Dilemma between Confidence and Calibration in Quantized Neural Networks

Guoxuan Xia, Sangwon Ha, Tiago Azevedo +1

Modern convolutional neural networks (CNNs) are known to be overconfident in terms of their calibration on unseen input data. That is to say, they are more confident than they are…

cs.LG2021★ 1 cited

Stochastic-Shield: A Probabilistic Approach Towards Training-Free Adversarial Defense in Quantized CNNs

Lorena Qendro, Sangwon Ha, René de Jong +1

Quantized neural networks (NN) are the common standard to efficiently deploy deep learning models on tiny hardware platforms. However, we notice that quantized NNs are as vulnerabl…

cs.NE2018★ 24 cited

Quantization for Rapid Deployment of Deep Neural Networks

Jun Haeng Lee, Sangwon Ha, Saerom Choi +2

This paper aims at rapid deployment of the state-of-the-art deep neural networks (DNNs) to energy efficient accelerators without time-consuming fine tuning or the availability of t…

cs.NE2018★ 4 cited

Training Deep Neural Network in Limited Precision

Hyunsun Park, Jun Haeng Lee, Youngmin Oh +2

Energy and resource efficient training of DNNs will greatly extend the applications of deep learning. However, there are three major obstacles which mandate accurate calculation in…