From pixels to notes: a computational implementation of synaesthesia for cultural artefacts
arXiv:2101.12038 · doi:10.1145/3399715.3400869
Abstract
Synaesthesia is a condition that enables people to sense information in the form of several senses at once. This work describes a Python implementation of a simulation of synaesthesia between listening to music and viewing a painting. Based on Scriabin's definition, we developed a deterministic process to produce a melody after processing a painting, mimicking the production of notes from colours in the field of view of persons experiencing synaesthesia.
AVI2CH 2020: Workshop on Advanced Visual Interfaces and Interactions in Cultural Heritage, Ischia, Italy - Sept 28-October 2, 2020