activity
20172025
most citedBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

565 citations · 1.1k across the 41 of their papers we have counts for

collaborators

48 papers

cs.AI2025★ 9 cited

Embodied AI Agents: Modeling the World

Pascale Fung, Yoram Bachrach, Asli Celikyilmaz +18

This paper describes our research on AI agents embodied in visual, virtual or physical forms, enabling them to interact with both users and their environments. These agents, which…

cs.CL2024

Granular Change Accuracy: A More Accurate Performance Metric for Dialogue State Tracking

Taha Aksu, Nancy F. Chen

Current metrics for evaluating Dialogue State Tracking (DST) systems exhibit three primary limitations. They: i) erroneously presume a uniform distribution of slots throughout the…

cs.LG2024★ 35 cited

Fine-Tuned Language Models Generate Stable Inorganic Materials as Text

Nate Gruver, Anuroop Sriram, Andrea Madotto +3

We propose fine-tuning large language models for generation of stable materials. While unorthodox, fine-tuning large language models on text-encoded atomistic data is simple to imp…

cs.CL2023

Continual Dialogue State Tracking via Example-Guided Question Answering

Hyundong Cho, Andrea Madotto, Zhaojiang Lin +5

Dialogue systems are frequently updated to accommodate new services, but naively updating them by continually training with data for new services in diminishing performance on prev…

cs.CL2022★ 565 cited

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448

Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabil…

cs.CL2022

Dialogue Summaries as Dialogue States (DS2), Template-Guided Summarization for Few-shot Dialogue State Tracking

Jamin Shin, Hangyeol Yu, Hyeongdon Moon +2

Annotating task-oriented dialogues is notorious for the expensive and difficult data collection process. Few-shot dialogue state tracking (DST) is a realistic solution to this prob…

cs.CL2021

CAiRE in DialDoc21: Data Augmentation for Information-Seeking Dialogue System

Etsuko Ishii, Yan Xu, Genta Indra Winata +5

Information-seeking dialogue systems, including knowledge identification and response generation, aim to respond to users with fluent, coherent, and informative responses based on…

cs.CL2021★ 35 cited

BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modeling

Zhaojiang Lin, Andrea Madotto, Genta Indra Winata +5

Task-oriented dialogue (ToD) benchmarks provide an important avenue to measure progress and develop better conversational agents. However, existing datasets for end-to-end ToD mode…

cs.CL2021★ 3 cited

Leveraging Slot Descriptions for Zero-Shot Cross-Domain Dialogue State Tracking

Zhaojiang Lin, Bing Liu, Seungwhan Moon +7

Zero-shot cross-domain dialogue state tracking (DST) enables us to handle task-oriented dialogue in unseen domains without the expense of collecting in-domain data. In this paper,…

cs.CL2021★ 10 cited

QAConv: Question Answering on Informative Conversations

Chien-Sheng Wu, Andrea Madotto, Wenhao Liu +2

This paper introduces QAConv, a new question answering (QA) dataset that uses conversations as a knowledge source. We focus on informative conversations, including business emails,…

cs.CL2021★ 17 cited

Retrieval-Free Knowledge-Grounded Dialogue Response Generation with Adapters

Yan Xu, Etsuko Ishii, Samuel Cahyawijaya +5

To diversify and enrich generated dialogue responses, knowledge-grounded dialogue has been investigated in recent years. The existing methods tackle the knowledge grounding challen…

cs.AI2021★ 2 cited

Dynamically Addressing Unseen Rumor via Continual Learning

Nayeon Lee, Andrea Madotto, Yejin Bang +1

Rumors are often associated with newly emerging events, thus, an ability to deal with unseen rumors is crucial for a rumor veracity classification model. Previous works address thi…

cs.CL2021

Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Grounding

Nouha Dziri, Andrea Madotto, Osmar Zaiane +1

Dialogue systems powered by large pre-trained language models (LM) exhibit an innate ability to deliver fluent and natural-looking responses. Despite their impressive generation pe…

cs.CL2021★ 2 cited

Mitigating Media Bias through Neutral Article Generation

Nayeon Lee, Yejin Bang, Andrea Madotto +1

Media bias can lead to increased political polarization, and thus, the need for automatic mitigation methods is growing. Existing mitigation work displays articles from multiple ne…

cs.CL2021

Are Multilingual Models Effective in Code-Switching?

Genta Indra Winata, Samuel Cahyawijaya, Zihan Liu +3

Multilingual language models have shown decent performance in multilingual and cross-lingual natural language understanding tasks. However, the power of these multilingual models i…

cs.CL2021

Towards Few-Shot Fact-Checking via Perplexity

Nayeon Lee, Yejin Bang, Andrea Madotto +2

Few-shot learning has drawn researchers' attention to overcome the problem of data scarcity. Recently, large pre-trained language models have shown great performance in few-shot le…

cs.CL2020★ 2 cited

Continual Learning in Task-Oriented Dialogue Systems

Andrea Madotto, Zhaojiang Lin, Zhenpeng Zhou +6

Continual learning in task-oriented dialogue systems can allow us to add new domains and functionalities through time without incurring the high cost of a whole system retraining.…

cs.CL2020★ 22 cited

CrossNER: Evaluating Cross-Domain Named Entity Recognition

Zihan Liu, Yan Xu, Tiezheng Yu +5

Cross-domain named entity recognition (NER) models are able to cope with the scarcity issue of NER samples in target domains. However, most of the existing NER benchmarks lack doma…

cs.CL2020

Plug-and-Play Conversational Models

Andrea Madotto, Etsuko Ishii, Zhaojiang Lin +2

There has been considerable progress made towards conversational models that generate coherent and fluent responses; however, this often involves training large language models on…

cs.CL2020

Learning Knowledge Bases with Parameters for Task-Oriented Dialogue Systems

Andrea Madotto, Samuel Cahyawijaya, Genta Indra Winata +4

Task-oriented dialogue systems are either modularized with separate dialogue state tracking (DST) and management steps or end-to-end trainable. In either case, the knowledge base (…

cs.CL2020★ 13 cited

MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems

Zhaojiang Lin, Andrea Madotto, Genta Indra Winata +1

In this paper, we propose Minimalist Transfer Learning (MinTL) to simplify the system design process of task-oriented dialogue systems and alleviate the over-dependency on annotate…

cs.CL2020★ 36 cited

Language Models as Few-Shot Learner for Task-Oriented Dialogue Systems

Andrea Madotto, Zihan Liu, Zhaojiang Lin +1

Task-oriented dialogue systems use four connected modules, namely, Natural Language Understanding (NLU), a Dialogue State Tracking (DST), Dialogue Policy (DP) and Natural Language…

cs.CL2020★ 5 cited

The Adapter-Bot: All-In-One Controllable Conversational Model

Andrea Madotto, Zhaojiang Lin, Yejin Bang +1

Considerable progress has been made towards conversational models that generate coherent and fluent responses by training large language models on large dialogue datasets. These mo…

cs.CL2020★ 25 cited

Misinformation Has High Perplexity

Nayeon Lee, Yejin Bang, Andrea Madotto +1

Debunking misinformation is an important and time-critical task as there could be adverse consequences when misinformation is not quashed promptly. However, the usual supervised ap…