MULTIDATA Summer Workshop 2025

This hands-on workshop will introduce participants to the MULTIDATA pipeline, covering transcription, speech analysis and OpenPose, followed by interactive sessions on applications in education and research. MULTIDATA is an ERASMUS PLUS KA220 HED project, involving the universities of Murcia, Radboud Nijmegen, and FAU Erlangen-Nürnberg as partners, and the MPI Psycholinguistics and the Red Hen Lab as associated partners. We offer an online platform for the study of multimodal communication (https://www.multi-data.eu/), including an AI-based pipeline to analyze speech and gesture data from videos, as well as other resources for developing audiovisual collections, as well as didactic materials and suggestions for exploiting video data inside and outside the classroom. This workshop will help you make the most of our open-source tools for analyzing gesture along with its co-occurring language and prosody.

IMPORTANT: Only 50 places are available and ISGS attendees will be prioritized. If you register after the event reaches full capacity, you will be placed on the waitlist.

📅 Date & Time: Monday, July 8, 2025 | 13:00 – 17:30

📍 Location: Max Planck Institute (Nijmegen)

📝 Registration: Free registration opens in April 2025

👥 Organizers: Cristóbal Pagán (University of Murcia), Peter Uhrig (FAU Erlangen-Nürnberg), Aslı Özyürek (MPI for Psycholinguistics)

WORKSHOP STRUCTURE

• Project introduction – Keynote: What MULTIDATA offers to researchers in multimodal communication (13:00-13:30 PM)
• Sign-up period (13:30-13:40 PM)
• Session + practice 1: Transcription, alignment and speech analysis (13:40PM-14:10PM). Description: How to obtain time-stamped transcriptions of videos and integrate them with ELAN, along with speech analysis information such as intensity, measured frame by frame.

[COFFEE BREAK 1; 14:10-14:35 PM]

• Session + practice 2: Pose estimation (14:35-15:25PM). Description: How to obtain a detailed analysis of human poses and movements.

[COFFEE BREAK 2; 15:25-15:50 PM]

• Showcase session (15:50-16:20PM). Description: Presentation of research results that were obtained by using the tools integrated in the MULTIDATA pipeline.
• Education session (16:20-16:50PM). Description: Exploring the use of MULTIDATA tools in educational settings.
• Data-analysis session (16:50-17:20PM). Description: Hands-on session where attendees can learn to use the MULTIDATA pipeline and the data it provides.
• Closing (17:20-17:30 PM)

Event Venue & Nearby Stays

Max Planck Institute for Psycholinguistics, 1 Wundtlaan, Nijmegen, Netherlands