SCENIC: A JAX Library for Computer Vision Research and Beyond
arXiv:2110.11403
Abstract
Scenic is an open-source JAX library with a focus on Transformer-based models for computer vision research and beyond. The goal of this toolkit is to facilitate rapid experimentation, prototyping, and research of new vision architectures and models. Scenic supports a diverse range of vision tasks (e.g., classification, segmentation, detection)and facilitates working on multi-modal problems, along with GPU/TPU support for multi-host, multi-device large-scale training. Scenic also offers optimized implementations of state-of-the-art research models spanning a wide range of modalities. Scenic has been successfully used for numerous projects and published papers and continues serving as the library of choice for quick prototyping and publication of new research ideas.
References in corpus (7)
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- MLP-Mixer: An all-MLP Architecture for Vision
- Attention Bottlenecks for Multimodal Fusion
- Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers
- Exploring the Limits of Large Scale Pre-training
- TokenLearner: What Can 8 Learned Tokens Do for Images and Videos?
- OmniNet: Omnidirectional Representations from Transformers