5 citations · 17 across the 13 of their papers we have counts for
Showing 2021Show all
3 papers · 1 filter
cs.CL2021
Word Acquisition in Neural Language Models
Tyler A. Chang, Benjamin K. Bergen
We investigate how neural language models acquire individual words during training, extracting learning curves and ages of acquisition for over 600 words on the MacArthur-Bates Com…
cs.CL2021★ 1 cited
Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models
Tyler A. Chang, Yifan Xu, Weijian Xu +1
In this paper, we detail the relationship between convolutions and self-attention in natural language tasks. We show that relative position embeddings in self-attention layers are…
cs.CV2021
Co-Scale Conv-Attentional Image Transformers
Weijian Xu, Yifan Xu, Tyler Chang +1
In this paper, we present Co-scale conv-attentional image Transformers (CoaT), a Transformer-based image classifier equipped with co-scale and conv-attentional mechanisms. First, t…