36 citations · 42 across the 5 of their papers we have counts for
5 papers
Supervision Complexity and its Role in Knowledge Distillation
Hrayr Harutyunyan, Ankit Singh Rawat, Aditya Krishna Menon +2
Despite the popularity and efficacy of knowledge distillation, there is limited understanding of why it helps. In order to study the generalization behavior of a distilled student,…
Teacher Guided Training: An Efficient Framework for Knowledge Transfer
Manzil Zaheer, Ankit Singh Rawat, Seungyeon Kim +5
The remarkable performance gains realized by large pretrained models, e.g., GPT-3, hinge on the massive amounts of data they are exposed to during training. Analogously, distilling…
Fast Spammer Detection Using Structural Rank
Seungyeon Kim, Haesun Park, Guy Lebanon
Comments for a product or a news article are rapidly growing and became a medium of measuring quality products or services. Consequently, spammers have been emerged in this area to…
Exact Partition Function Zeros of a Polymer on a Simple-Cubic Lattice
Jae Hwan Lee, Seung-Yeon Kim, Julian Lee
We study conformational transitions of a polymer on a simple-cubic lattice by calculating the zeros of the exact partition function, up to chain length 24. In the complex temperatu…
Cumulative Revision Map
Seungyeon Kim, Joshua V. Dillon, Guy Lebanon
Unlike static documents, version-controlled documents are edited by one or more authors over a certain period of time. Examples include large scale computer code, papers authored b…