18 citations · 53 across the 25 of their papers we have counts for
34 papers
Preserving Privacy Without Compromising Accuracy: Machine Unlearning for Handwritten Text Recognition
Lei Kang, Xuanshuo Fu, Lluis Gomez +3
Handwritten Text Recognition (HTR) is crucial for document digitization, but handwritten data can contain user-identifiable features, like unique writing styles, posing privacy ris…
Transductive Learning for Near-Duplicate Image Detection in Scanned Photo Collections
Francesc Net, Marc Folia, Pep Casals +1
This paper presents a comparative study of near-duplicate image detection techniques in a real-world use case scenario, where a document management company is commissioned to manua…
GRIF-DM: Generation of Rich Impression Fonts using Diffusion Models
Lei Kang, Fei Yang, Kai Wang +5
Fonts are integral to creative endeavors, design processes, and artistic productions. The appropriate selection of a font can significantly enhance artwork and endow advertisements…
Machine Unlearning for Document Classification
Lei Kang, Mohamed Ali Souibgui, Fei Yang +3
Document understanding models have recently demonstrated remarkable performance by leveraging extensive collections of user documents. However, since documents often contain large…
Show, Interpret and Tell: Entity-aware Contextualised Image Captioning in Wikipedia
Khanh Nguyen, Ali Furkan Biten, Andres Mafla +2
Humans exploit prior knowledge to describe images, and are able to adapt their explanation to specific contextual information, even to the extent of inventing plausible explanation…
MUST-VQA: MUltilingual Scene-text VQA
Emanuele Vivoli, Ali Furkan Biten, Andres Mafla +2
In this paper, we present a framework for Multilingual Scene Text Visual Question Answering that deals with new languages in a zero-shot fashion. Specifically, we consider the task…
A Generic Image Retrieval Method for Date Estimation of Historical Document Collections
Adrià Molina, Lluis Gomez, Oriol Ramos Terrades +1
Date estimation of historical document images is a challenging problem, with several contributions in the literature that lack of the ability to generalize from one dataset to othe…
Text-DIAE: A Self-Supervised Degradation Invariant Autoencoders for Text Recognition and Document Enhancement
Mohamed Ali Souibgui, Sanket Biswas, Andres Mafla +6
In this paper, we propose a Text-Degradation Invariant Auto Encoder (Text-DIAE), a self-supervised model designed to tackle two tasks, text recognition (handwritten or scene-text)…
OCR-IDL: OCR Annotations for Industry Document Library Dataset
Ali Furkan Biten, Rubèn Tito, Lluis Gomez +2
Pretraining has proven successful in Document Intelligence tasks where deluge of documents are used to pretrain the models only later to be finetuned on downstream tasks. One of th…
Is An Image Worth Five Sentences? A New Look into Semantics for Image-Text Matching
Ali Furkan Biten, Andres Mafla, Lluis Gomez +1
The task of image-text matching aims to map representations from different modalities into a common joint visual-textual embedding. However, the most widely used datasets for this…
Asking questions on handwritten document collections
Minesh Mathew, Lluis Gomez, Dimosthenis Karatzas +1
This work addresses the problem of Question Answering (QA) on handwritten document collections. Unlike typical QA and Visual Question Answering (VQA) formulations where the answer…
Date Estimation in the Wild of Scanned Historical Photos: An Image Retrieval Approach
Adrià Molina, Pau Riba, Lluis Gomez +2
This paper presents a novel method for date estimation of historical photographs from archival sources. The main contribution is to formulate the date estimation as a retrieval tas…
Learning to Rank Words: Optimizing Ranking Metrics for Word Spotting
Pau Riba, Adrià Molina, Lluis Gomez +2
In this paper, we explore and evaluate the use of ranking-based objective functions for learning simultaneously a word string and a word image encoder. We consider retrieval framew…
One-shot Compositional Data Generation for Low Resource Handwritten Text Recognition
Mohamed Ali Souibgui, Ali Furkan Biten, Sounak Dey +5
Low resource Handwritten Text Recognition (HTR) is a hard problem due to the scarce annotated data and the very limited linguistic information (dictionaries and language models). F…
Multi-Modal Reasoning Graph for Scene-Text Based Fine-Grained Image Classification and Retrieval
Andres Mafla, Sounak Dey, Ali Furkan Biten +2
Scene text instances found in natural images carry explicit semantic information that can provide important cues to solve a wide array of computer vision problems. In this paper, w…
Text Recognition -- Real World Data and Where to Find Them
Klára Janoušková, Jiri Matas, Lluis Gomez +1
We present a method for exploiting weakly annotated images to improve text extraction pipelines. The approach uses an arbitrary end-to-end text recognition system to obtain text re…
Location Sensitive Image Retrieval and Tagging
Raul Gomez, Jaume Gibert, Lluis Gomez +1
People from different parts of the globe describe objects and concepts in distinct manners. Visual appearance can thus vary across different geographic locations, which makes locat…
RoadText-1K: Text Detection & Recognition Dataset for Driving Videos
Sangeeth Reddy, Minesh Mathew, Lluis Gomez +3
Perceiving text is crucial to understand semantics of outdoor scenes and hence is a critical requirement to build intelligent systems for driver assistance and self-driving. Most o…
Fine-grained Image Classification and Retrieval by Combining Visual and Locally Pooled Textual Features
Andres Mafla, Sounak Dey, Ali Furkan Biten +2
Text contained in an image carries high-level semantics that can be exploited to achieve richer image understanding. In particular, the mere presence of text provides strong guidin…
Exploring Hate Speech Detection in Multimodal Publications
Raul Gomez, Jaume Gibert, Lluis Gomez +1
In this work we target the problem of hate speech detection in multimodal publications formed by a text and an image. We gather and annotate a large scale dataset from Twitter, MMH…
ICDAR 2019 Competition on Scene Text Visual Question Answering
Ali Furkan Biten, Rubèn Tito, Andres Mafla +6
This paper presents final results of ICDAR 2019 Scene Text Visual Question Answering competition (ST-VQA). ST-VQA introduces an important aspect that is not addressed by any Visual…
Selective Style Transfer for Text
Raul Gomez, Ali Furkan Biten, Lluis Gomez +3
This paper explores the possibilities of image style transfer applied to text maintaining the original transcriptions. Results on different text domains (scene text, machine printe…
Scene Text Visual Question Answering
Ali Furkan Biten, Ruben Tito, Andres Mafla +5
Current visual question answering datasets do not consider the rich semantic information conveyed by text within an image. In this work, we present a new dataset, ST-VQA, that aims…
Good News, Everyone! Context driven entity-aware captioning for news images
Ali Furkan Biten, Lluis Gomez, Marçal Rusiñol +1
Current image captioning systems perform at a merely descriptive level, essentially enumerating the objects in the scene and their relations. Humans, on the contrary, interpret ima…