15 citations · 47 across the 8 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
cs.CV2022
Effective Self-supervised Pre-training on Low-compute Networks without Distillation
Fuwen Tan, Fatemeh Saleh, Brais Martinez
Despite the impressive progress of self-supervised learning (SSL), its applicability to low-compute networks has received limited attention. Reported performance has trailed behind…
cs.CV2022
iBoot: Image-bootstrapped Self-Supervised Video Representation Learning
Fatemeh Saleh, Fuwen Tan, Adrian Bulat +2
Learning visual representations through self-supervision is an extremely challenging task as the network needs to sieve relevant patterns from spurious distractors without the acti…
cs.CV2022★ 15 cited
EdgeViTs: Competing Light-weight CNNs on Mobile Devices with Vision Transformers
Junting Pan, Adrian Bulat, Fuwen Tan +5
Self-attention based models such as vision transformers (ViTs) have emerged as a very competitive architecture alternative to convolutional neural networks (CNNs) in computer visio…