MIM · Enhancing Motion Interaction through Music Performance
Horizon 2020 — Marie Skłodowska-Curie Actions
- Duration
- 2016-01-04 → 2019-01-03
- EU contribution
- €232,160
- Participants
- 3
- Scheme
- MSCA-IF-GF
Lines connect the coordinator with its partners.
Results in brief
Enhancing Motion Interaction through Music Performance
As Information Communications Technology (ICT) is now spreading outside of workspaces towards our everyday life, new elements of human life such as culture, emotion or experience must be embraced in technology for Human-Computer Interaction (HCI). Part of this new objective in HCI is to build technologies that are “closer”, or more “natural”, to human, promoting the use of body movement in HCI. Exploring this challenge has been the cornerstone of digital arts and especially performing arts involving digital media. For example, music technologists have leveraged on motion sensing technology to explore new types of interaction between the body and digital medias. Nevertheless, there is a general agreement that these new interactive systems remain less satisfying in terms of expressive control compared to traditional instruments, and, importantly, do not allow to acquire skills through them. The general objective of the project MIM is to investigate motor learning mechanisms in expert motor activity, especially instrumental music practice, in order to enhance movement computational models in movement-based musical interaction systems. The project MIM addresses three specific scientific objectives: - Objective 1: Study the role of movement task variation in music skill acquisition, - Objective 2: Study the nature of movement variability and learning schedules in the development of motor learning, - Objective 3: Build interactive systems facilitating motor learning.
Data: CORDIS, © European Union
Project objective
The proposed project aims to enhance Human Motion–Computer Interaction by leveraging on a multidisciplinary approach between experimental psychology, music technology and computational modelling. Firstly, the project looks at skilled activities, in particular music performance, in order to understand fundamental cognitive and psychological aspects of control and expression in human motion. The project involves computational models of motor control and expressive variations built from music performance data collected during psychophysical studies. Secondly, the project broaches the implementation of these models in Digital Musical Instruments (DMI), thus creating a new type of digital instrument based on sensorimotor learning mechanisms. The resulting DMI is then assessed through a user study in which elements of exploration and engagement will be tested over several sessions. Therefore, the project contributes to two main uncharted research areas. Firstly it contributes to the fundamental understanding of sensorimotor learning processes by considering complex human motion, specifically motion in music performance. Secondly, it represents an original application of computational modelling by modelling expressive musical gestures and transferring these models to interactive systems.
Original text from CORDIS.
Participants
Links
Data: CORDIS, © European Union