1.5k citations · 2.2k across the 24 of their papers we have counts for
12 papers · 1 filter
A Theory of Contrastive Learning with Natural Images
Antonio Torralba, Yair Weiss
Why does contrastive learning with simple images and augmentations yield useful representations for downstream tasks? We address this question by analytically computing the optimal…
What Color is the Sky (for a non-human) ?
Yair Weiss, Ofer Springer
The light of the daytime sky contains a mixture of many colors yet is perceived as blue by human observers. This is largely due to the particular response functions of the human co…
Is the Modality Gap a Bug or a Feature? A Robustness Perspective
Rhea Chowers, Oshri Naparstek, Udi Barzelay +1
Many modern multi-modal models (e.g. CLIP) seek an embedding space in which the two modalities are aligned. Somewhat surprisingly, almost all existing models show a strong modality…
What do CNNs Learn in the First Layer and Why? A Linear Systems Perspective
Rhea Chowers, Yair Weiss
It has previously been reported that the representation that is learned in the first layer of deep Convolutional Neural Networks (CNNs) is highly consistent across initializations…
Generating natural images with direct Patch Distributions Matching
Ariel Elnekave, Yair Weiss
Many traditional computer vision algorithms generate realistic images by requiring that each patch in the generated image be similar to a patch in a training image and vice versa.…
Posterior Sampling for Image Restoration using Explicit Patch Priors
Roy Friedman, Yair Weiss
Almost all existing methods for image restoration are based on optimizing the mean squared error (MSE), even though it is known that the best estimate in terms of MSE may yield a h…