35 citations · 121 across the 18 of their papers we have counts for
20 papers
Are Expressions for Music Emotions the Same Across Cultures?
Elif Celen, Pol van Rijn, Harin Lee +1
Music evokes profound emotions, yet the universality of emotional descriptors across languages remains debated. A key challenge in cross-cultural research on music emotion is biase…
Characterizing Similarities and Divergences in Conversational Tones in Humans and LLMs by Sampling with People
Dun-Ming Huang, Pol Van Rijn, Ilia Sucholutsky +2
Conversational tones -- the manners and attitudes in which speakers communicate -- are essential to effective communication. Amidst the increasing popularization of Large Language…
Representational Alignment Supports Effective Machine Teaching
Ilia Sucholutsky, Katherine M. Collins, Maya Malaviya +11
A good teacher should not only be knowledgeable, but should also be able to communicate in a way that the student understands -- to share the student's representation of the world.…
A Rational Analysis of the Speech-to-Song Illusion
Raja Marjieh, Pol van Rijn, Ilia Sucholutsky +3
The speech-to-song illusion is a robust psychological phenomenon whereby a spoken sentence sounds increasingly more musical as it is repeated. Despite decades of research, a comple…
Giving Robots a Voice: Human-in-the-Loop Voice Creation and open-ended Labeling
Pol van Rijn, Silvan Mertes, Kathrin Janowski +3
Speech is a natural interface for humans to interact with robots. Yet, aligning a robot's voice to its appearance is challenging due to the rich vocabulary of both modalities. Prev…
Getting aligned on representational alignment
Ilia Sucholutsky, Lukas Muttenthaler, Adrian Weller +30
Biological and artificial information processing systems form representations of the world that they can use to categorize, reason, plan, navigate, and make decisions. How can we m…
The Universal Law of Generalization Holds for Naturalistic Stimuli
Raja Marjieh, Nori Jacoby, Joshua C. Peterson +1
Shepard's universal law of generalization is a remarkable hypothesis about how intelligent organisms should perceive similarity. In its broadest form, the universal law states that…
Around the world in 60 words: A generative vocabulary test for online research
Pol van Rijn, Yue Sun, Harin Lee +5
Conducting experiments with diverse participants in their native languages can uncover insights into culture, cognition, and language that may not be revealed otherwise. However, c…
Large language models predict human sensory judgments across six modalities
Raja Marjieh, Ilia Sucholutsky, Pol van Rijn +2
Determining the extent to which the perceptual world can be recovered from language is a longstanding problem in philosophy and cognitive science. We show that state-of-the-art lar…
On the Informativeness of Supervision Signals
Ilia Sucholutsky, Ruairidh M. Battleday, Katherine M. Collins +7
Supervised learning typically focuses on learning transferable representations from training examples annotated by humans. While rich annotations (like soft labels) carry more info…
Analyzing Diffusion as Serial Reproduction
Raja Marjieh, Ilia Sucholutsky, Thomas A. Langlois +2
Diffusion models are a class of generative models that learn to synthesize samples by inverting a diffusion process that gradually maps data into noise. While these models have enj…
Words are all you need? Language as an approximation for human similarity judgments
Raja Marjieh, Pol van Rijn, Ilia Sucholutsky +4
Human similarity judgments are a powerful supervision signal for machine learning applications based on techniques such as contrastive learning, information retrieval, and model al…
Bridging the prosody GAP: Genetic Algorithm with People to efficiently sample emotional prosody
Pol van Rijn, Harin Lee, Nori Jacoby
The human voice effectively communicates a range of emotions with nuanced variations in acoustics. Existing emotional speech corpora are limited in that they are either (a) highly…
WavThruVec: Latent speech representation as intermediate features for neural speech synthesis
Hubert Siuzdak, Piotr Dura, Pol van Rijn +1
Recent advances in neural text-to-speech research have been dominated by two-stage pipelines utilizing low-level intermediate speech representation such as mel-spectrograms. Howeve…
VoiceMe: Personalized voice generation in TTS
Pol van Rijn, Silvan Mertes, Dominik Schiller +5
Novel text-to-speech systems can generate entirely new voices that were not seen during training. However, it remains a difficult task to efficiently create personalized voices fro…
Predicting Human Similarity Judgments Using Large Language Models
Raja Marjieh, Ilia Sucholutsky, Theodore R. Sumers +2
Similarity judgments provide a well-established method for accessing mental representations, with applications in psychology, neuroscience and machine learning. However, collecting…
Cross-cultural Mood Perception in Pop Songs and its Alignment with Mood Detection Algorithms
Harin Lee, Frank Hoeger, Marc Schoenwiesner +2
Do people from different cultural backgrounds perceive the mood in music the same way? How closely do human ratings across different cultures approximate automatic mood detection a…
Passive Attention in Artificial Neural Networks Predicts Human Visual Selectivity
Thomas A. Langlois, H. Charles Zhao, Erin Grant +3
Developments in machine learning interpretability techniques over the past decade have provided new tools to observe the image regions that are most informative for classification…
Exploring emotional prototypes in a high dimensional TTS latent space
Pol van Rijn, Silvan Mertes, Dominik Schiller +4
Recent TTS systems are able to generate prosodically varied and realistic speech. However, it is unclear how this prosodic variation contributes to the perception of speakers' emot…
Gibbs Sampling with People
Peter M. C. Harrison, Raja Marjieh, Federico Adolfi +5
A core problem in cognitive science and machine learning is to understand how humans derive semantic representations from perceptual objects, such as color from an apple, pleasantn…