EMHCAM · Embodied Multimodal Human Communication and Modelling

Lines connect the coordinator with its partners. CORDIS does not always give exact coordinates for projects before 2014. These points are placed at city or country level.

Project objective

The EMHCAM Doctoral Network will train 15 doctoral candidates to advance European research in Embodied Multimodal Human Communication And Modelling. Despite rapid progress in language and vision AI, current systems lack grounding in the embodied and context-dependent nature of human communication. This limits progress in key application domains such as socially interactive agents, accessibility technologies and health-related human–machine interaction. EMHCAM addresses this gap by integrating three research communities — gesture and cognitive interaction studies, multimodal corpus development and multimodal data science — into a single, coherent doctoral training network.The network tackles three interconnected scientific challenges: 1) developing new theoretical accounts of how speech and gesture jointly structure communication across languages, speaker profiles and interaction settings; 2) creating the next generation of embodied multimodal corpora, linking audio–visual and motion-captured data with shared annotation conventions and making them available through ethical data-sharing methods; 3) designing computational models that analyse and generate multimodal behaviour, including LLM-based generation pipelines and context-aware behavioural modelling.The resulting resources — open multimodal datasets, validated annotation schemes, evaluation benchmarks and ethically robust modelling pipelines — will have concrete impact across academia and industry. Application areas include intelligent hearing aid design, socially interactive agents for mental healthcare and multimodal learning technologies. By combining advanced technical training, strong industry participation and an interdisciplinary, cross-European research environment, EMHCAM will produce a new generation of researchers equipped to shape human-centred, trustworthy and inclusive multimodal technologies in line with European strategic priorities.

Original text from CORDIS.

Participants

• KOBENHAVNS UNIVERSITET · KOBENHAVNCoordinatorDenmark
• Aryza Ireland Limited · DublinCity levelIreland
• ENDURAE VOICE TECHNOLOGY OU · TallinnCity levelEstonia
• JOHANN WOLFGANG GOETHE-UNIVERSITAET FRANKFURT AM MAIN · Frankfurt Am MainGermany
• KATHOLIEKE UNIVERSITEIT LEUVEN · LeuvenBelgium
• KUNGLIGA TEKNISKA HOEGSKOLAN · StockholmSweden
• LINNEUNIVERSITETET · VaxjoSweden
• LUNDS UNIVERSITET · LundSweden
• SORBONNE UNIVERSITE · ParisFrance
• STOCKHOLMS UNIVERSITET · StockholmSweden
• THE PROVOST, FELLOWS, FOUNDATION SCHOLARS & THE OTHER MEMBERS OF BOARD, OF THE COLLEGE OF THE HOLY & UNDIVIDED TRINITY OF QUEEN ELIZABETH NEAR DUBLIN · DublinIreland
• TOBII AB · DanderydSweden
• UNIVERSIDAD POMPEU FABRA · BarcelonaSpain
• UNIVERSITAET BIELEFELD · BielefeldGermany
• UNIVERSITY COLLEGE LONDON · LondonUnited Kingdom
• Université de Montpellier Paul-Valéry · MontpellierFrance
• WS Audiology A/S · LyngeCity levelDenmark
• iMotions A/S · CopenhagenDenmark

Links

• View on CORDIS
• DOI: 10.3030/101310000