2 papers
cs.LG2023
Concept-Monitor: Understanding DNN training through individual neurons
Mohammad Ali Khan, Tuomas Oikarinen, Tsui-Wei Weng
In this work, we propose a general framework called Concept-Monitor to help demystify the black-box DNN training processes automatically using a novel unified embedding space and c…
cs.LG2020
Compressing Large-Scale Transformer-Based Models: A Case Study on BERT
Prakhar Ganesh, Yao Chen, Xin Lou +6
Pre-trained Transformer-based models have achieved state-of-the-art performance for various Natural Language Processing (NLP) tasks. However, these models often have billions of pa…