630 citations · 1.6k across the 22 of their papers we have counts for
6 papers · 1 filter
Efficient inference in occlusion-aware generative models of images
Jonathan Huang, Kevin Murphy
We present a generative model of images based on layering, in which image layers are individually generated, then composited from front to back. We are thus able to factor the appe…
Detecting events and key actors in multi-person videos
Vignesh Ramanathan, Jonathan Huang, Sami Abu-El-Haija +3
Multi-person event recognition is a challenging task, often with many people active in the scene but only a small subset contributing to an actual event. In this paper, we propose…
Generation and Comprehension of Unambiguous Object Descriptions
Junhua Mao, Jonathan Huang, Alexander Toshev +3
We propose a method that can generate an unambiguous description (known as a referring expression) of a specific object or region in an image, and which can also comprehend or inte…
Deep Knowledge Tracing
Chris Piech, Jonathan Spencer, Jonathan Huang +4
Knowledge tracing---where a machine models the knowledge of a student as they interact with coursework---is a well established problem in computer supported education. Though effec…
Learning Program Embeddings to Propagate Feedback on Student Code
Chris Piech, Jonathan Huang, Andy Nguyen +3
Providing feedback, both assessing final work and giving hints to stuck students, is difficult for open-ended assignments in massive online classes which can range from thousands t…
What's Cookin'? Interpreting Cooking Videos using Text, Speech and Vision
Jonathan Malmaud, Jonathan Huang, Vivek Rathod +3
We present a novel method for aligning a sequence of instructions to a video of someone carrying out a task. In particular, we focus on the cooking domain, where the instructions c…