Temporal Image Caption Retrieval Competition -- Description and Results

Abstract

Multimodal models, which combine visual and textual information, have recently gained significant recognition. This paper addresses the multimodal challenge of Text-Image retrieval and introduces a novel task that extends the modalities to include temporal data. The Temporal Image Caption Retrieval Competition (TICRC) presented in this paper is based on the Chronicling America and Challenging America projects, which offer access to an extensive collection of digitized historic American newspapers spanning 274 years. In addition to the competition results, we provide an analysis of the delivered dataset and the process of its creation.

References in corpus (7)

• Learning Transferable Visual Models From Natural Language Supervision
• Hierarchical Text-Conditional Image Generation with CLIP Latents
• Flamingo: a Visual Language Model for Few-Shot Learning
• Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision
• LAION-5B: An open large-scale dataset for training next generation image-text models
• Time-Aware Language Models as Temporal Knowledge Bases
• EVA-CLIP: Improved Training Techniques for CLIP at Scale