Showing 2023Show all
2 papers · 1 filter
cs.CL2023
On the effect of curriculum learning with developmental data for grammar acquisition
Mattia Opper, J. Morrison, N. Siddharth
This work explores the degree to which grammar acquisition is driven by language `simplicity' and the source modality (speech vs. text) of data. Using BabyBERTa as a probe, we find…
cs.CL2023
StrAE: Autoencoding for Pre-Trained Embeddings using Explicit Structure
Mattia Opper, Victor Prokhorov, N. Siddharth
This work presents StrAE: a Structured Autoencoder framework that through strict adherence to explicit structure, and use of a novel contrastive objective over tree-structured repr…