activity
20212023
most citedAlexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems

64 citations · 75 across the 7 of their papers we have counts for

collaborators

8 papers

cs.HC2023★ 2 cited

Alexa, play with robot: Introducing the First Alexa Prize SimBot Challenge on Embodied AI

Hangjie Shi, Leslie Ball, Govind Thattai +39

The Alexa Prize program has empowered numerous university students to explore, experiment, and showcase their talents in building conversational agents through challenges like the…

cs.CL2023

AMPERE: AMR-Aware Prefix for Generation-Based Event Argument Extraction Model

I-Hung Hsu, Zhiyu Xie, Kuan-Hao Huang +2

Event argument extraction (EAE) identifies event arguments and their specific roles for a given event. Recent advancement in generation-based EAE models has shown great performance…

cs.CL2022★ 64 cited

Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems

Jack FitzGerald, Shankar Ananthakrishnan, Konstantine Arkoudas +38

We present results from a large-scale experiment on pretraining encoders with non-embedding parameter counts ranging from 700M to 9.3B, their subsequent distillation into smaller m…

cs.CL2022★ 2 cited

TAGPRIME: A Unified Framework for Relational Structure Extraction

I-Hung Hsu, Kuan-Hao Huang, Shuning Zhang +4

Many tasks in natural language processing require the extraction of relationship information for a given condition, such as event argument extraction, relation extraction, and task…

cs.CV2022★ 5 cited

A Thousand Words Are Worth More Than a Picture: Natural Language-Centric Outside-Knowledge Visual Question Answering

Feng Gao, Qing Ping, Govind Thattai +3

Outside-knowledge visual question answering (OK-VQA) requires the agent to comprehend the image, make use of relevant knowledge from the entire web, and digest all the information…

cs.CV2021

BioFors: A Large Biomedical Image Forensics Dataset

Ekraam Sabir, Soumyaroop Nandi, Wael AbdAlmageed +1

Research in media forensics has gained traction to combat the spread of misinformation. However, most of this research has been directed towards content generated on social media.…

cs.CL2021★ 2 cited

DEGREE: A Data-Efficient Generation-Based Event Extraction Model

I-Hung Hsu, Kuan-Hao Huang, Elizabeth Boschee +4

Event extraction requires high-quality expert human annotations, which are usually expensive. Therefore, learning a data-efficient event extraction model that can be trained with o…

cs.CV2021

Learning Better Visual Dialog Agents with Pretrained Visual-Linguistic Representation

Tao Tu, Qing Ping, Govind Thattai +2

GuessWhat?! is a two-player visual dialog guessing game where player A asks a sequence of yes/no questions (Questioner) and makes a final guess (Guesser) about a target object in a…