Many people have heard the word “synaesthesia,” but very few know what it means. The term describes situations in which certain feelings awaken other feelings in a person. It occurs very infrequently and only in a small number of people. As an example, when viewing the work of artists, the music inside starts to sound. This phenomenon is difficult to explain, but even more difficult to ignore.
The experiment will look for rules, correspondences and build a system from them. The already existing Google Transformer network, once trained by musicians from the NSDOS collective and Antoine Bertin, will be used as a base. It is assumed that the neural network will analyze Kandinsky’s works and correlate the color scheme with the sounds so that viewing a painting will be accompanied by music in harmony with it. Will AI be able to cope with such a non-trivial task?