11 citations · 11 across the 3 of their papers we have counts for
5 papers
REViT-v2: Hierarchical Windowed Roto-reflection Equivariant ViT for Equivariant Feature Extraction
Sheir A. Zaheer, Jihwan Moon, Chan Y. Park
We propose a scalable roto-reflection-group-equivariant vision transformer based on windowed group-convolutional self-attention and a hierarchical feature architecture. We demonstr…
Greedy Local Learning for Language Model Pretraining: Gaps and Objective Design
Jihwan Moon, Sheir A. Zaheer, Jinmyoung Lee +2
Greedy block-wise local learning splits a network into gradient-isolated blocks trained by local auxiliary losses, deleting the backward pass between blocks: inter-stage communicat…
REViT: Roto-reflection Equivariant Convolutional Vision Transformer
Sheir A. Zaheer, Alexander C. Holston, Chan Y. Park
In this paper, we propose a discrete roto-reflection group equivariant vision transformer with convolutional attention. Roto-reflection equivariant networks preserve the rotational…
Drift-Augmented Scoring: Text-Derived Noise Robustness for Zero-Shot Audio-Language Classification
Tu Vo, Sheir Zaheer, Chan Y. Park
Contrastive audio-language models such as CLAP enable zero-shot audio classification: a sound is labelled by matching its embedding to text prompt embeddings, with no labelled audi…
NTIRE 2022 Challenge on High Dynamic Range Imaging: Methods and Results
Eduardo Pérez-Pellitero, Sibi Catley-Chandar, Richard Shaw +85
This paper reviews the challenge on constrained high dynamic range (HDR) imaging that was part of the New Trends in Image Restoration and Enhancement (NTIRE) workshop, held in conj…