1 citations · 1 across the 2 of their papers we have counts for
4 papers
Word Acquisition in Neural Language Models
Tyler A. Chang, Benjamin K. Bergen
We investigate how neural language models acquire individual words during training, extracting learning curves and ages of acquisition for over 600 words on the MacArthur-Bates Com…
Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models
Tyler A. Chang, Yifan Xu, Weijian Xu +1
In this paper, we detail the relationship between convolutions and self-attention in natural language tasks. We show that relative position embeddings in self-attention layers are…
Co-Scale Conv-Attentional Image Transformers
Weijian Xu, Yifan Xu, Tyler Chang +1
In this paper, we present Co-scale conv-attentional image Transformers (CoaT), a Transformer-based image classifier equipped with co-scale and conv-attentional mechanisms. First, t…
Encodings of Source Syntax: Similarities in NMT Representations Across Target Languages
Tyler A. Chang, Anna N. Rafferty
We train neural machine translation (NMT) models from English to six target languages, using NMT encoder representations to predict ancestor constituent labels of source language w…