10 citations · 28 across the 12 of their papers we have counts for
13 papers
Integrating Linguistic Theory and Neural Language Models
Bai Li
Transformer-based language models have recently achieved remarkable results in many natural language tasks. However, performance on leaderboards is generally achieved by leveraging…
On the data requirements of probing
Zining Zhu, Jixuan Wang, Bai Li +1
As large and powerful neural language models are developed, researchers have been increasingly interested in developing diagnostic tools to probe them. There are many papers with c…
Neural reality of argument structure constructions
Bai Li, Zining Zhu, Guillaume Thomas +2
In lexicalist linguistic theories, argument structure is assumed to be predictable from the meaning of verbs. As a result, the verb is the primary determinant of the meaning of a c…
What do writing features tell us about AI papers?
Zining Zhu, Bai Li, Yang Xu +1
As the numbers of submissions to conferences grow quickly, the task of assessing the quality of academic papers automatically, convincingly, and with high accuracy attracts increas…
How is BERT surprised? Layerwise detection of linguistic anomalies
Bai Li, Zining Zhu, Guillaume Thomas +2
Transformer language models have shown remarkable ability in detecting when a word is anomalous in context, but likelihood scores offer no information about the cause of the anomal…
TorontoCL at CMCL 2021 Shared Task: RoBERTa with Multi-Stage Fine-Tuning for Eye-Tracking Prediction
Bai Li, Frank Rudzicz
Eye movement data during reading is a useful source of information for understanding language comprehension processes. In this paper, we describe our submission to the CMCL 2021 sh…
Evolution of Part-of-Speech in Classical Chinese
Bai Li
Classical Chinese is a language notable for its word class flexibility: the same word may often be used as a noun or a verb. Bisang (2008) claimed that Classical Chinese is a preca…
Word class flexibility: A deep contextualized approach
Bai Li, Guillaume Thomas, Yang Xu +1
Word class flexibility refers to the phenomenon whereby a single word form is used across different grammatical categories. Extensive work in linguistic typology has sought to char…
Representation Learning for Discovering Phonemic Tone Contours
Bai Li, Jing Yi Xie, Frank Rudzicz
Tone is a prosodic feature used to distinguish words in many languages, some of which are endangered and scarcely documented. In this work, we use unsupervised representation learn…
Real-world Conversational AI for Hotel Bookings
Bai Li, Nanyi Jiang, Joey Sham +2
In this paper, we present a real-world conversational AI system to search for and book hotels through text messaging. Our architecture consists of a frame-based dialogue management…
Detecting dementia in Mandarin Chinese using transfer learning from a parallel corpus
Bai Li, Yi-Te Hsu, Frank Rudzicz
Machine learning has shown promise for automatic detection of Alzheimer's disease (AD) through speech; however, efforts are hampered by a scarcity of data, especially in languages…
Dropout during inference as a model for neurological degeneration in an image captioning network
Bai Li, Ran Zhang, Frank Rudzicz
We replicate a variation of the image captioning architecture by Vinyals et al. (2015), then introduce dropout during inference mode to simulate the effects of neurodegenerative di…
State Complexity of Overlap Assembly
Janusz Brzozowski, Lila Kari, Bai Li +1
The \emph{state complexity} of a regular language is the number of states in a minimal deterministic finite automaton (DFA) accepting . The state complexity of a reg…