activity
20182025
most citedBig Self-Supervised Models are Strong Semi-Supervised Learners

465 citations · 710 across the 17 of their papers we have counts for

collaborators
Showing 2020Show all

6 papers · 1 filter

cs.CV2020

Human 3D keypoints via spatial uncertainty modeling

Francis Williams, Or Litany, Avneesh Sud +2

We introduce a technique for 3D human keypoint estimation that directly models the notion of spatial uncertainty of a keypoint. Our technique employs a principled approach to model…

cs.LG2020★ 8 cited

Learned Hardware/Software Co-Design of Neural Accelerators

Zhan Shi, Chirag Sakhuja, Milad Hashemi +2

The use of deep learning has grown at an exponential rate, giving rise to numerous specialized hardware and software systems for deep learning. Because the design space of deep lea…

cs.LG2020★ 7 cited

No MCMC for me: Amortized sampling for fast and stable training of energy-based models

Will Grathwohl, Jacob Kelly, Milad Hashemi +3

Energy-Based Models (EBMs) present a flexible and appealing way to represent uncertainty. Despite recent advances, training EBMs on high-dimensional data remains a challenging prob…

cs.LG2020★ 5 cited

An Imitation Learning Approach for Cache Replacement

Evan Zheran Liu, Milad Hashemi, Kevin Swersky +2

Program execution speed critically depends on increasing cache hits, as cache hits are orders of magnitude faster than misses. To increase cache hits, we focus on the problem of ca…

cs.LG2020★ 465 cited

Big Self-Supervised Models are Strong Semi-Supervised Learners

Ting Chen, Simon Kornblith, Kevin Swersky +2

One paradigm for learning from few labeled examples while making best use of a large amount of unlabeled data is unsupervised pretraining followed by supervised fine-tuning. Althou…

cs.LG2020★ 7 cited

Neural Execution Engines: Learning to Execute Subroutines

Yujun Yan, Kevin Swersky, Danai Koutra +2

A significant effort has been made to train neural networks that replicate algorithmic reasoning, but they often fail to learn the abstract concepts underlying these algorithms. Th…