OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Models

Abstract

We introduce OpenFlamingo, a family of autoregressive vision-language models ranging from 3B to 9B parameters. OpenFlamingo is an ongoing effort to produce an open-source replication of DeepMind's Flamingo models. On seven vision-language datasets, OpenFlamingo models average between 80 - 89% of corresponding Flamingo performance. This technical report describes our models, training data, hyperparameters, and evaluation suite. We share our models and code at https://github.com/mlfoundations/open_flamingo.

Cited by in corpus (6)

• OCRBench: On the Hidden Mystery of OCR in Large Multimodal Models
• ROCOv2: Radiology Objects in COntext Version 2, an Updated Multimodal Image Dataset
• The Survey on Multi-Source Data Fusion in Cyber-Physical-Social Systems:Foundational Infrastructure for Industrial Metaverses and Industries 5.0
• Foundation Models and Transformers for Anomaly Detection: A Survey
• ConditionNET: Learning Preconditions and Effects for Execution Monitoring
• Medical Vision Language Models as Policies for Robotic Surgery