7 citations · 11 across the 3 of their papers we have counts for
4 papers · 1 filter
Enhancing Self-Consistency and Performance of Pre-Trained Language Models through Natural Language Inference
Eric Mitchell, Joseph J. Noh, Siyan Li +5
While large pre-trained language models are powerful, their predictions often lack logical consistency across test inputs. For example, a state-of-the-art Macaw question-answering…
Systematicity in GPT-3's Interpretation of Novel English Noun Compounds
Siyan Li, Riley Carlson, Christopher Potts
Levin et al. (2019) show experimentally that the interpretations of novel English noun compounds (e.g., stew skillet), while not fully compositional, are highly predictable based o…
Automatic Story Generation: Challenges and Attempts
Amal Alabdulkarim, Siyan Li, Xiangyu Peng
The scope of this survey paper is to explore the challenges in automatic story generation. We hope to contribute in the following ways: 1. Explore how previous research in story ge…
Reducing Non-Normative Text Generation from Language Models
Xiangyu Peng, Siyan Li, Spencer Frazier +1
Large-scale, transformer-based language models such as GPT-2 are pretrained on diverse corpora scraped from the internet. Consequently, they are prone to generating non-normative t…