activity
20192023
most citedAlexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems

64 citations · 66 across the 7 of their papers we have counts for

collaborators

7 papers

cs.CV2023★ 1 cited

FashionNTM: Multi-turn Fashion Image Retrieval via Cascaded Memory

Anwesan Pal, Sahil Wadhwa, Ayush Jaiswal +5

Multi-turn textual feedback-based fashion image retrieval focuses on a real-world setting, where users can iteratively provide information to refine retrieval results until they fi…

cs.CV2023

MoMo: A shared encoder Model for text, image and multi-Modal representations

Rakesh Chada, Zhaoheng Zheng, Pradeep Natarajan

We propose a self-supervised shared encoder model that achieves strong results on several visual, language and multimodal benchmarks while being data, memory and run-time efficient…

cs.CL2022★ 64 cited

Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems

Jack FitzGerald, Shankar Ananthakrishnan, Konstantine Arkoudas +38

We present results from a large-scale experiment on pretraining encoders with non-embedding parameter counts ranging from 700M to 9.3B, their subsequent distillation into smaller m…

cs.CL2021

FewshotQA: A simple framework for few-shot learning of question answering tasks using pre-trained text-to-text models

Rakesh Chada, Pradeep Natarajan

The task of learning from only a few examples (called a few-shot setting) is of key importance and relevance to a real-world setting. For question answering (QA), the current state…

cs.CL2021

Error Detection in Large-Scale Natural Language Understanding Systems Using Transformer Models

Rakesh Chada, Pradeep Natarajan, Darshan Fofadiya +1

Large-scale conversational assistants like Alexa, Siri, Cortana and Google Assistant process every utterance using multiple models for domain, intent and named entity recognition.…

cs.CL2020

Simultaneous paraphrasing and translation by fine-tuning Transformer models

Rakesh Chada

This paper describes the third place submission to the shared task on simultaneous translation and paraphrasing for language education at the 4th workshop on Neural Generation and…

cs.CL2019★ 1 cited

Gendered Pronoun Resolution using BERT and an extractive question answering formulation

Rakesh Chada

The resolution of ambiguous pronouns is a longstanding challenge in Natural Language Understanding. Recent studies have suggested gender bias among state-of-the-art coreference res…