67 citations · 297 across the 34 of their papers we have counts for
43 papers
ScaleDet: A Scalable Multi-Dataset Object Detector
Yanbei Chen, Manchen Wang, Abhay Mittal +4
Multi-dataset training provides a viable solution for exploiting heterogeneous large-scale datasets without extra annotation cost. In this work, we propose a scalable multi-dataset…
Benchmarking Zero-Shot Recognition with Vision-Language Models: Challenges on Granularity and Specificity
Zhenlin Xu, Yi Zhu, Tiffany Deng +6
This paper presents novel benchmarks for evaluating vision-language models (VLMs) in zero-shot recognition, focusing on granularity and specificity. Although VLMs excel in tasks li…
A Meta-Learning Approach to Predicting Performance and Data Requirements
Achin Jain, Gurumurthy Swaminathan, Paolo Favaro +8
We propose an approach to estimate the number of samples required for a model to reach a target performance. We find that the power law, the de facto principle to estimate model pe…
Spatio-Temporal Crop Aggregation for Video Representation Learning
Sepehr Sameni, Simon Jenni, Paolo Favaro
We propose Spatio-temporal Crop Aggregation for video representation LEarning (SCALE), a novel method that enjoys high scalability at both training and inference time. Our model bu…
Efficient Video Prediction via Sparsely Conditioned Flow Matching
Aram Davtyan, Sepehr Sameni, Paolo Favaro
We introduce a novel generative model for video prediction based on latent flow matching, an efficient alternative to diffusion-based models. In contrast to prior work, we keep the…
MOVE: Unsupervised Movable Object Segmentation and Detection
Adam Bielski, Paolo Favaro
We introduce MOVE, a novel method to segment objects without any form of supervision. MOVE exploits the fact that foreground objects can be shifted locally relative to their initia…
Semi-supervised Vision Transformers at Scale
Zhaowei Cai, Avinash Ravichandran, Paolo Favaro +5
We study semi-supervised learning (SSL) for vision transformers (ViT), an under-explored topic despite the wide adoption of the ViT architectures to different tasks. To tackle this…
Controllable Video Generation through Global and Local Motion Dynamics
Aram Davtyan, Paolo Favaro
We present GLASS, a method for Global and Local Action-driven Sequence Synthesis. GLASS is a generative model that is trained on video sequences in an unsupervised manner and that…
Representation Learning by Detecting Incorrect Location Embeddings
Sepehr Sameni, Simon Jenni, Paolo Favaro
In this paper, we introduce a novel self-supervised learning (SSL) loss for image representation learning. There is a growing belief that generalization in deep neural networks is…
Learning to Deblur and Rotate Motion-Blurred Faces
Givi Meishvili, Attila Szabó, Simon Jenni +1
We propose a solution to the novel task of rendering sharp videos from new viewpoints from a single motion-blurred image of a face. Our method handles the complexity of face blur b…
Generative Adversarial Learning via Kernel Density Discrimination
Abdelhak Lemkhenter, Adam Bielski, Alp Eren Sari +1
We introduce Kernel Density Discrimination GAN (KDD GAN), a novel method for generative adversarial learning. KDD GAN formulates the training as a likelihood ratio optimization pro…
KOALA: A Kalman Optimization Algorithm with Loss Adaptivity
Aram Davtyan, Sepehr Sameni, Llukman Cerkezi +3
Optimization is often cast as a deterministic problem, where the solution is found through some iterative procedure such as gradient descent. However, when training neural networks…
A Unified Generative Adversarial Network Training via Self-Labeling and Self-Attention
Tomoki Watanabe, Paolo Favaro
We propose a novel GAN training scheme that can handle any level of labeling in a unified manner. Our scheme introduces a form of artificial labeling that can incorporate manually…
Optical Flow Dataset Synthesis from Unpaired Images
Adrian Wälchli, Paolo Favaro
The estimation of optical flow is an ambiguous task due to the lack of correspondence at occlusions, shadows, reflections, lack of texture and changes in illumination over time. Th…
ISD: Self-Supervised Learning by Iterative Similarity Distillation
Ajinkya Tejankar, Soroush Abbasi Koohpayegani, Vipin Pillai +2
Recently, contrastive learning has achieved great results in self-supervised learning, where the main idea is to push two augmentations of an image (positive pairs) closer compared…
Boosting Generalization in Bio-Signal Classification by Learning the Phase-Amplitude Coupling
Abdelhak Lemkhenter, Paolo Favaro
Various hand-crafted features representations of bio-signals rely primarily on the amplitude or power of the signal in specific frequency bands. The phase component is often discar…
Self-Supervised Multi-View Synchronization Learning for 3D Pose Estimation
Simon Jenni, Paolo Favaro
Current state-of-the-art methods cast monocular 3D human pose estimation as a learning problem by training neural networks on large data sets of images and corresponding skeleton p…
Video Representation Learning by Recognizing Temporal Transformations
Simon Jenni, Givi Meishvili, Paolo Favaro
We introduce a novel self-supervised learning approach to learn representations of videos that are responsive to changes in the motion dynamics. Our representations can be learned…
Learning to Model and Calibrate Optics via a Differentiable Wave Optics Simulator
Josue Page, Paolo Favaro
We present a novel learning-based method to build a differentiable computational model of a real fluorescence microscope. Our model can be used to calibrate a real optical setup di…
Steering Self-Supervised Feature Learning Beyond Local Pixel Statistics
Simon Jenni, Hailin Jin, Paolo Favaro
We introduce a novel principle for self-supervised feature learning based on the discrimination of specific transformations of an image. We argue that the generalization capability…
Learning to Reconstruct Confocal Microscopy Stacks from Single Light Field Images
Josue Page, Federico Saltarin, Yury Belyaev +2
We present a novel deep learning approach to reconstruct confocal microscopy stacks from single light field images. To perform the reconstruction, we introduce the LFMNet, a novel…
Unsupervised Generative 3D Shape Learning from Natural Images
Attila Szabó, Givi Meishvili, Paolo Favaro
In this paper we present, to the best of our knowledge, the first method to learn a generative model of 3D shapes from natural images in a fully unsupervised way. For example, we d…
Learning to Have an Ear for Face Super-Resolution
Givi Meishvili, Simon Jenni, Paolo Favaro
We propose a novel method to use both audio and a low-resolution image to perform extreme face super-resolution (a 16x increase of the input size). When the resolution of the input…
On Stabilizing Generative Adversarial Training with Noise
Simon Jenni, Paolo Favaro
We present a novel method and analysis to train generative adversarial networks (GAN) in a stable manner. As shown in recent analysis, training is often undermined by the probabili…