1.7k citations · 3.4k across the 31 of their papers we have counts for
35 papers
VideoFlexTok: Flexible-Length Coarse-to-Fine Video Tokenization
Andrei Atanov, Jesse Allardice, Roman Bachmann +6
Visual tokenizers map high-dimensional raw pixels into a compressed representation for downstream modeling. Beyond compression, tokenizers dictate what information is preserved and…
Value function estimation using conditional diffusion models for control
Bogdan Mazoure, Walter Talbott, Miguel Angel Bautista +3
A fairly reliable trend in deep reinforcement learning is that the performance scales with the number of parameters, provided a complimentary scaling in amount of training data. As…
PatchBlender: A Motion Prior for Video Transformers
Gabriele Prato, Yale Song, Janarthanan Rajendran +3
Transformers have become one of the dominant architectures in the field of computer vision. However, there are yet several challenges when applying such architectures to video data…
Self-supervised multimodal neuroimaging yields predictive representations for a spectrum of Alzheimer's phenotypes
Alex Fedorov, Eloy Geenjaar, Lei Wu +7
Recent neuroimaging studies that focus on predicting brain disorders via modern machine learning approaches commonly include a single modality and rely on supervised over-parameter…
The Sandbox Environment for Generalizable Agent Research (SEGAR)
R Devon Hjelm, Bogdan Mazoure, Florian Golemo +5
A broad challenge of research on generalization for sequential decision-making tasks in interactive environments is designing benchmarks that clearly landmark progress. While there…
Robust Contrastive Learning against Noisy Views
Ching-Yao Chuang, R Devon Hjelm, Xin Wang +5
Contrastive learning relies on an assumption that positive pairs contain related views, e.g., patches of an image or co-occurring multimodal signals of a video, that share certain…