4 papers
Texture Representations in Deep Vision Models: Comparing CNNs, Vision Transformers, and Human Perception
Ludovica de Paolis, Marco Baroni, Alessandro Laio +1
In computational vision science, Convolutional Neural Networks (CNNs) have emerged as a popular model of biological vision because of the alignment they can exhibit with neural and…
A quantitative analysis of semantic information in deep representations of text and images
Santiago Acevedo, Andrea Mascaretti, Riccardo Rende +3
It was recently observed that the representations of different models that process identical or semantically related inputs tend to align. We analyze this phenomenon using the Info…
Differential syntactic and semantic encoding in LLMs
Santiago Acevedo, Alessandro Laio, Marco Baroni
We study how syntactic and semantic information is encoded in inner layer representations of Large Language Models (LLMs), focusing on the very large DeepSeek-V3. We find that, by…
Similarity of Processing Steps in Vision Model Representations
Matéo Mahaut, Marco Baroni
Recent literature suggests that the bigger the model, the more likely it is to converge to similar, ``universal'' representations, despite different training objectives, datasets,…