25 citations · 31 across the 7 of their papers we have counts for
8 papers
Model Interpretability and Rationale Extraction by Input Mask Optimization
Marc Brinner, Sina Zarriess
Concurrent to the rapid progress in the development of neural-network based models in areas like natural language processing and computer vision, the need for creating explanations…
Evaluating Diversity in Automatic Poetry Generation
Yanran Chen, Hannes Gröner, Sina Zarrieß +1
Natural Language Generation (NLG), and more generally generative AI, are among the currently most impactful research fields. Creative NLG, such as automatic poetry generation, is a…
Paparazzi: A Deep Dive into the Capabilities of Language and Vision Models for Grounding Viewpoint Descriptions
Henrik Voigt, Jan Hombeck, Monique Meuschke +2
Existing language and vision models achieve impressive performance in image-text understanding. Yet, it is an open question to what extent they can be used for language understandi…
Enabling Robots to Draw and Tell: Towards Visually Grounded Multimodal Description Generation
Ting Han, Sina Zarrieß
Socially competent robots should be equipped with the ability to perceive the world that surrounds them and communicate about it in a human-like manner. Representative skills that…
MeetUp! A Corpus of Joint Activity Dialogues in a Visual Environment
Nikolai Ilinykh, Sina Zarrieß, David Schlangen
Building computer systems that can converse about their visual environment is one of the oldest concerns of research in Artificial Intelligence and Computational Linguistics (see,…
Know What You Don't Know: Modeling a Pragmatic Speaker that Refers to Objects of Unknown Categories
Sina Zarrieß, David Schlangen
Zero-shot learning in Language & Vision is the task of correctly labelling (or naming) objects of novel categories. Another strand of work in L&V aims at pragmatically informative…
The Code2Text Challenge: Text Generation in Source Code Libraries
Kyle Richardson, Sina Zarrieß, Jonas Kuhn
We propose a new shared task for tactical data-to-text generation in the domain of source code libraries. Specifically, we focus on text generation of function descriptions from ex…
Resolving References to Objects in Photographs using the Words-As-Classifiers Model
David Schlangen, Sina Zarriess, Casey Kennington
A common use of language is to refer to visually present objects. Modelling it in computers requires modelling the link between language and perception. The "words as classifiers"…