15 citations · 27 across the 13 of their papers we have counts for
16 papers
The Iconicity of the Generated Image
Nanne van Noord, Noa Garcia
How humans interpret and produce images is influenced by the images we have been exposed to. Similarly, visual generative AI models are exposed to many training images and learn to…
Stylistic Multi-Task Analysis of Ukiyo-e Woodblock Prints
Selina Khan, Nanne van Noord
In this work we present a large-scale dataset of \textit{Ukiyo-e} woodblock prints. Unlike previous works and datasets in the artistic domain that primarily focus on western art, t…
Context-Infused Visual Grounding for Art
Selina Khan, Nanne van Noord
Many artwork collections contain textual attributes that provide rich and contextualised descriptions of artworks. Visual grounding offers the potential for localising subjects wit…
TULIP: Token-length Upgraded CLIP
Ivona Najdenkoska, Mohammad Mahdi Derakhshani, Yuki M. Asano +3
We address the challenge of representing long captions in vision-language models, such as CLIP. By design these models are limited by fixed, absolute positional encodings, restrict…
GO4Align: Group Optimization for Multi-Task Alignment
Jiayi Shen, Cheems Wang, Zehao Xiao +2
This paper proposes \textit{GO4Align}, a multi-task optimization approach that tackles task imbalance by explicitly aligning the optimization across tasks. To achieve this, we desi…
An Analytics of Culture: Modeling Subjectivity, Scalability, Contextuality, and Temporality
Nanne van Noord, Melvin Wevers, Tobias Blanke +2
There is a bidirectional relationship between culture and AI; AI models are increasingly used to analyse culture, thereby shaping our understanding of culture. On the other hand, t…
Hyperbolic Image Segmentation
Mina GhadimiAtigh, Julian Schoep, Erman Acar +2
For image segmentation, the current standard is to perform pixel-level optimization and inference in Euclidean output embedding spaces through linear hyperplanes. In this work, we…
The Met Dataset: Instance-level Recognition for Artworks
Nikolaos-Antonios Ypsilantis, Noa Garcia, Guangxing Han +3
This work introduces a dataset for large-scale instance-level recognition in the domain of artworks. The proposed benchmark exhibits a number of different challenges such as large…
Extending CLIP for Category-to-image Retrieval in E-commerce
Mariya Hendriksen, Maurits Bleeker, Svitlana Vakulenko +3
E-commerce provides rich multimodal data that is barely leveraged in practice. One aspect of this data is a category tree that is being used in search and recommendation. However,…
Inside Out Visual Place Recognition
Sarah Ibrahimi, Nanne van Noord, Tim Alpherts +1
Visual Place Recognition (VPR) is generally concerned with localizing outdoor images. However, localizing indoor scenes that contain part of an outdoor scene can be of large value…
Translating Visual Art into Music
Maximilian Müller-Eberstein, Nanne van Noord
The Synesthetic Variational Autoencoder (SynVAE) introduced in this research is able to learn a consistent mapping between visual and auditive sensory modalities in the absence of…
I Bet You Are Wrong: Gambling Adversarial Networks for Structured Semantic Segmentation
Laurens Samson, Nanne van Noord, Olaf Booij +3
Adversarial training has been recently employed for realizing structured semantic segmentation, in which the aim is to preserve higher-level scene structural consistencies in dense…
Learning Task Relatedness in Multi-Task Learning for Images in Context
Gjorgji Strezoski, Nanne van Noord, Marcel Worring
Multimedia applications often require concurrent solutions to multiple tasks. These tasks hold clues to each-others solutions, however as these relations can be complex this remain…
Many Task Learning with Task Routing
Gjorgji Strezoski, Nanne van Noord, Marcel Worring
Typical multi-task learning (MTL) methods rely on architectural adjustments and a large trainable parameter set to jointly optimize over several tasks. However, when the number of…
Light-weight pixel context encoders for image inpainting
Nanne van Noord, Eric Postma
In this work we propose Pixel Content Encoders (PCE), a light-weight image inpainting model, capable of generating novel con-tent for large missing regions in images. Unlike previo…
Exploring the influence of scale on artist attribution
Nanne van Noord, Eric Postma
Previous work has shown that the artist of an artwork can be identified by use of computational methods that analyse digital images. However, the digitised artworks are often inves…