5 papers
Self-Supervised Representation Learning via Hyperspherical Density Shaping
Esteban Rodríguez-Betancourt, Edgar Casasola-Murillo
Modern self-supervised representation learning methods often relies on empirical heuristics that are not theoretically grounded. In this study we propose HyDeS, a theoretically gro…
Geometric Analysis of Self-Supervised Vision Representations for Semantic Image Retrieval
Esteban Rodríguez-Betancourt, Edgar Casasola-Murillo
Content-based image retrieval (CBIR) systems enable users to search images based on visual content instead of relying on metadata. The text domain has benefited from vector search…
Randomly Initialized Networks Can Learn from Peer-to-Peer Consensus
Esteban Rodríguez-Betancourt, Edgar Casasola-Murillo
In self-supervised learning, self-distilled methods have shown impressive performance, learning representations useful for downstream tasks and even displaying emergent properties.…
Hypersolid: Emergent Vision Representations via Short-Range Repulsion
Esteban Rodríguez-Betancourt, Edgar Casasola-Murillo
A central problem in self-supervised learning is preventing representation collapse. Most methods avoid it through global mechanisms, such as contrastive expansion, variance constr…
From cart to truck: meaning shift through words in English in the last two centuries
Esteban Rodríguez Betancourt, Edgar Casasola Murillo
This onomasiological study uses diachronic word embeddings to explore how different words represented the same concepts over time, using historical word data from 1800 to 2000. We…