6 papers
Linguistic Distancing on Social Media: Indicators of Emotion Regulation Across Age Groups
Daniela Teodorescu, Saif M. Mohammad, Alona Fyshe
Managing our emotional responses to events is key to emotional well-being, a process referred to as emotion regulation in psychology. Previous work has established that the degree…
Understanding the Staged Dynamics of Transformers in Learning Latent Structure
Rohan Saha, Farzane Aminmansour, Alona Fyshe
Language modeling has shown us that transformers can discover latent structure from context, but the dynamics of how they acquire different components of that structure remain poor…
Offline Preference Optimization via Maximum Marginal Likelihood Estimation
Saeed Najafi, Alona Fyshe
Aligning Large Language Models (LLMs) with human preferences is crucial, but standard methods like Reinforcement Learning from Human Feedback (RLHF) are often complex and unstable.…
How to optimize neuroscience data utilization and experiment design for advancing brain models of visual and linguistic cognition?
Greta Tuckute, Dawn Finzi, Eshed Margalit +8
In recent years, neuroscience has made significant progress in building large-scale artificial neural network (ANN) models of brain activity and behavior. However, there is no cons…
Exploring Curriculum Learning for Vision-Language Tasks: A Study on Small-Scale Multimodal Training
Rohan Saha, Abrar Fahim, Alona Fyshe +1
For specialized domains, there is often not a wealth of data with which to train large machine learning models. In such limited data / compute settings, various methods exist aimin…
Finding Shared Decodable Concepts and their Negations in the Brain
Cory Efird, Alex Murphy, Joel Zylberberg +1
Prior work has offered evidence for functional localization in the brain; different anatomical regions preferentially activate for certain types of visual input. For example, the f…