Human Inspired Progressive Alignment and Comparative Learning for Grounded Word Acquisition

Abstract

Human language acquisition is an efficient, supervised, and continual process. In this work, we took inspiration from how human babies acquire their first language, and developed a computational process for word acquisition through comparative learning. Motivated by cognitive findings, we generated a small dataset that enables the computation models to compare the similarities and differences of various attributes, learn to filter out and extract the common information for each shared linguistic label. We frame the acquisition of words as not only the information filtration process, but also as representation-symbol mapping. This procedure does not involve a fixed vocabulary size, nor a discriminative objective, and allows the models to continually learn more concepts efficiently. Our results in controlled experiments have shown the potential of this approach for efficient continual learning of grounded words.

References in corpus (14)

• Overcoming catastrophic forgetting in neural networks
• A Simple Framework for Contrastive Learning of Visual Representations
• ShapeNet: An Information-Rich 3D Model Repository
• Hierarchical Text-Conditional Image Generation with CLIP Latents
• Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding
• ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks
• Three scenarios for continual learning
• SimVLM: Simple Visual Language Model Pretraining with Weak Supervision
• Variational Continual Learning
• A Theory of Generative ConvNet
• Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis
• Unsupervised Learning of Compositional Energy Concepts
• ZeroC: A Neuro-Symbolic Model for Zero-shot Concept Recognition and Acquisition at Inference Time
• Learning to Mediate Disparities Towards Pragmatic Communication