HEИндивидуална стипендия2023–2024

PPA · Performance Precision Annotator (PPA): AI-Assisted Annotation and Analysis of Music Performance

„Хоризонт Европа“ — Действия „Мария Склодовска-Кюри“

Период: 2023-07-01 → 2024-07-31
Финансиране от ЕС: 99 451 €
Участници: 1
Схема: HORIZON-TMA-MSCA-PF-EF

Линиите свързват координатора с партньорите.

Накратко на български

Изкуственият интелект се използва за автоматично маркиране на темпото и началото на нотите в музикални записи, например при сравнение на различни изпълнения на една и съща композиция. Това улеснява анализа на стила и експресивността, като заменя бавния ръчен процес на анотиране.

Този кратък обзор е генериран от изкуствен интелект

Кратко обяснение, генерирано от езиков модел по текста на CORDIS. Оригиналът е по-долу.

Резултати накратко

Performance Precision Annotator (PPA): AI-Assisted Annotation and Analysis of Music Performance

Music scholars doing performance analysis are interested in examining performance characteristics such as style and expressiveness. Typically, they collect multiple performance recordings of the same piece and compare their nuances. For example, they will often compare performance recordings of the same piece from different decades to discover historical trends; if the performances were by the same artist, then they could use these recordings to study this artist’s stylistic changes over time. Currently, music scholars often conduct such research by manually annotating musical elements in performance recordings, such as downbeats, pitch, and note onset times. However, such manual annotation approach can be tedious and inefficient. More importantly, existing tools do not incorporate musical score information, often a vital element when analyzing performances. This project aims to create a software tool to facilitate music performance analysis. Provided with a digital musical score and a performance of that score, the software automatically generates meaningful AI-driven annotations about note onsets and tempo, fully integrated with the score. Beyond the software, this project also gathers evidence of the usefulness of such tools. In conclusion, from our user study, our developed tool demonstrated meaningful value for research in music performance analysis. The user study also provided important insights for future refinement of such tools.

Текст от CORDIS, на английски · Данни: CORDIS, © Европейски съюз

Цел на проекта

In the internet era, vast troves of sound recordings and musical scores have become available to virtually anyone, but drawing connections between these two mediums to develop insights about performance style and artistic expression has remained a difficult and time-consuming task. Currently, music scholars rely on general--purpose sound editing tools for annotating musical elements in recordings (such as downbeats, pitch, or note onsets); however, these annotations often must be entered manually, and these tools do not incorporate one vital element needed for analyzing recordings: musical score information. This approach can be labor intensive and inefficient, and limits the scope of the data that can be analyzed. To help address this need, we seek this fellowship to develop PPA, a prototype open--source software tool for annotating and analyzing recorded music performances, bringing innovations from the interdisciplinary Music Information Retrieval (MIR) community to scholars and musicians in the humanities. Provided with a (digital) musical score and a performance of that score, the software will automatically generate meaningful AI--driven annotations about (e.g.) note onsets, dynamics, articulations, or tempo, fully integrated with the score. With an easy--to--use graphical user interface, the software will display and visualize the score, the audio, and the selected annotations in intuitive ways designed to streamline performance analysis. Besides developing the prototype, we propose to conduct use-case studies, gathering evidence to illuminate ways PPA can be used to assist musicology scholarship, and to inform future development of the software.

Оригинален текст от CORDIS (на английски).

Участници

UNIVERSITAT FUR MUSIK UND DARSTELLENDE KUNST WIEN · WIENКоординаторАвстрия