Emotion-aware Music Tower Blocks

Science Communication Project for the Linz Ars Electronica Festival 2021 - Co-PI role

EmoMTB has been showcased at the Linz Ars Electronica Festival 2021. We also have a teaser video on Youtube, a ICMR Demo paper, and a IJMIR Journal publication.
I have been involved in this project as a Co-PI. My responsibilities included system design, tasks assignment, API integration development, and data analysis. Implemented in JavaScript and Python.

PI: Markus Schedl
Co-PI: Alessandro B. Melchiorre, Oleg Lesota, David Penz, Emilia Parada-Cabaleiro
Funding: 54,000 EUR
Runtime: March - Sept 2021
People: 9


EmoMTB’s landscape

Emotion-aware Music Tower Blocks (EmoMTB) is an audiovisual interface to explore large music collections. It creates a musical landscape, by adopting the metaphor of a city, where similar songs are grouped into the same building and nearby buildings form neighborhoods of particular genres. In order to personalize the user experience, an underlying classifier monitors textual user-generated content, by this predicting their emotional state and adapting the audiovisual elements of the interface accordingly. EmoMTB enables users to explore different musical styles either within their comfort zone or outside of it. Besides, tailoring the results of the recommender engine to match the affective state of the user, EmoMTB offers a unique way to discover and enjoy music.

EmoMTB’s landscape for the four emotional themes.