354 citations · 699 across the 9 of their papers we have counts for
11 papers
MS-nowcasting: Operational Precipitation Nowcasting with Convolutional LSTMs at Microsoft Weather
Sylwester Klocek, Haiyu Dong, Matthew Dixon +7
We present the encoder-forecaster convolutional long short-term memory (LSTM) deep-learning model that powers Microsoft Weather's operational precipitation nowcasting product. This…
Object-Centric Image Generation from Layouts
Tristan Sylvain, Pengchuan Zhang, Yoshua Bengio +2
Despite recent impressive results on single-object and single-domain image generation, the generation of complex scenes with multiple objects remains challenging. In this paper, we…
From FiLM to Video: Multi-turn Question Answering with Multi-modal Context
Dat Tien Nguyen, Shikhar Sharma, Hannes Schulz +1
Understanding audio-visual content and the ability to have an informative conversation about it have both been challenging areas for intelligent systems. The Audio Visual Scene-awa…
Tell, Draw, and Repeat: Generating and Modifying Images Based on Continual Linguistic Instruction
Alaaeldin El-Nouby, Shikhar Sharma, Hannes Schulz +5
Conditional text-to-image generation is an active area of research, with many possible applications. Existing research has primarily focused on generating a single image from avail…
ChatPainter: Improving Text to Image Generation using Dialogue
Shikhar Sharma, Dendi Suhubdy, Vincent Michalski +2
Synthesizing realistic images from text descriptions on a dataset like Microsoft Common Objects in Context (MS COCO), where each image can contain several objects, is a challenging…
Relevance of Unsupervised Metrics in Task-Oriented Dialogue for Evaluating Natural Language Generation
Shikhar Sharma, Layla El Asri, Hannes Schulz +1
Automated metrics such as BLEU are widely used in the machine translation literature. They have also been used recently in the dialogue community for evaluating dialogue response g…
A Frame Tracking Model for Memory-Enhanced Dialogue Systems
Hannes Schulz, Jeremie Zumer, Layla El Asri +1
Recently, resources and tasks were proposed to go beyond state tracking in dialogue systems. An example is the frame tracking task, which requires recording multiple frames, one fo…
Frames: A Corpus for Adding Memory to Goal-Oriented Dialogue Systems
Layla El Asri, Hannes Schulz, Shikhar Sharma +5
This paper presents the Frames dataset (Frames is available at http://datasets.maluuba.com/Frames), a corpus of 1369 human-human dialogues with an average of 15 turns per dialogue.…
Natural Language Generation in Dialogue using Lexicalized and Delexicalized Data
Shikhar Sharma, Jing He, Kaheer Suleman +2
Natural language generation plays a critical role in spoken dialogue systems. We present a new approach to natural language generation for task-oriented dialogue using recurrent ne…
Learning Preferences for Manipulation Tasks from Online Coactive Feedback
Ashesh Jain, Shikhar Sharma, Thorsten Joachims +1
We consider the problem of learning preferences over trajectories for mobile manipulators such as personal robots and assembly line robots. The preferences we learn are more intric…
Action Recognition using Visual Attention
Shikhar Sharma, Ryan Kiros, Ruslan Salakhutdinov
We propose a soft attention based model for the task of action recognition in videos. We use multi-layered Recurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM) units…