2 papers
cs.CV2023
Pre-training with Random Orthogonal Projection Image Modeling
Maryam Haghighat, Peyman Moghadam, Shaheer Mohamed +1
Masked Image Modeling (MIM) is a powerful self-supervised strategy for visual pre-training without the use of labels. MIM applies random crops to input images, processes them with…
cs.CV2023
FactoFormer: Factorized Hyperspectral Transformers with Self-Supervised Pretraining
Shaheer Mohamed, Maryam Haghighat, Tharindu Fernando +3
Hyperspectral images (HSIs) contain rich spectral and spatial information. Motivated by the success of transformers in the field of natural language processing and computer vision…