activity
20202023
most citedAlexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems

64 citations · 92 across the 7 of their papers we have counts for

collaborators

8 papers

cs.CV2023★ 1 cited

FashionNTM: Multi-turn Fashion Image Retrieval via Cascaded Memory

Anwesan Pal, Sahil Wadhwa, Ayush Jaiswal +5

Multi-turn textual feedback-based fashion image retrieval focuses on a real-world setting, where users can iteratively provide information to refine retrieval results until they fi…

cs.SI2023★ 23 cited

Social network modeling and applications, a tutorial

Lisette Espín-Noboa, Tiago Peixoto, Fariba Karimi

Social networks have been widely studied over the last century from multiple disciplines to understand societal issues such as inequality in employment rates, managerial performanc…

cs.CV2023

MoMo: A shared encoder Model for text, image and multi-Modal representations

Rakesh Chada, Zhaoheng Zheng, Pradeep Natarajan

We propose a self-supervised shared encoder model that achieves strong results on several visual, language and multimodal benchmarks while being data, memory and run-time efficient…

cs.CL2022★ 64 cited

Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems

Jack FitzGerald, Shankar Ananthakrishnan, Konstantine Arkoudas +38

We present results from a large-scale experiment on pretraining encoders with non-embedding parameter counts ranging from 700M to 9.3B, their subsequent distillation into smaller m…

cs.CL2021

FewshotQA: A simple framework for few-shot learning of question answering tasks using pre-trained text-to-text models

Rakesh Chada, Pradeep Natarajan

The task of learning from only a few examples (called a few-shot setting) is of key importance and relevance to a real-world setting. For question answering (QA), the current state…

cs.CL2021

Error Detection in Large-Scale Natural Language Understanding Systems Using Transformer Models

Rakesh Chada, Pradeep Natarajan, Darshan Fofadiya +1

Large-scale conversational assistants like Alexa, Siri, Cortana and Google Assistant process every utterance using multiple models for domain, intent and named entity recognition.…

cs.CV2021★ 4 cited

Style-Aware Normalized Loss for Improving Arbitrary Style Transfer

Jiaxin Cheng, Ayush Jaiswal, Yue Wu +2

Neural Style Transfer (NST) has quickly evolved from single-style to infinite-style models, also known as Arbitrary Style Transfer (AST). Although appealing results have been widel…

cs.CV2020

Class-agnostic Object Detection

Ayush Jaiswal, Yue Wu, Pradeep Natarajan +1

Object detection models perform well at localizing and classifying objects that they are shown during training. However, due to the difficulty and cost associated with creating and…