ABOUT

Project
Edit project The Development of Interactive Multi-sensory Audio-Visual Platform Using Synesthetic Experience See project The Development of Interactive Multi-sensory Audio-Visual Platform Using Synesthetic ExperienceSee project
Project nameThe Development of Interactive Multi-sensory Audio-Visual Platform Using Synesthetic Experience
Project descriptionMusic is one of the greatest sensory pleasures available to the human ear. Yet how can this pleasure be enhanced when combined with other stimuli, which work to engage other senses, simultaneously? It is a question that has been addressed by a variety of music visualisations – from simple desktop apps to live audio-visual mixing in nightclubs – and brought joy to those who experience it.

Yet there are also a certain group of people who, through some genetic twist of fate, experience this multi-sensory combination naturally – a phenomenon we call synesthesia. This group of people have been known throughout history to possess high levels of creativity, and their contributions to culture – especially within painting and music – is vast.

Therefore, in light of substantial research the topic of synesthesia and creativity, in this project, I aimed to find the correlation between sound and colour and to compile the results in an interactive real-time audio-visual demonstration – and to see whether this recreation of synesthesia can enhance and inspire creativity within my test subjects.

The application was written in Max/MSP and Logic Pro X which translates real-time audio and MIDI events into chromatically mapped graphical objects. Logic Pro X was chosen as main playback medium for the project due to its feature set and ease of integration.