1 of 42

Nordic CoE Meet Up Gothenburg 2024

2 of 42

Some facts about Gothenburg

Founded in 1621
“Venice of the North”
5th largest city in the Nordic countries (600 000)
Göteborg (yacht-a-bore(g)) = “Garden bridge”
Liseberg is Sweden’s largest tourist attraction
The largest port in the Nordic countries

3 of 42

About the programme

4 of 42

About the programme

5 of 42

About the programme

6 of 42

Practicalities

Emergency exits

Toilets

Check-in / check-out (before 12:00 Thursday)

Breakfast (06:30-10:00, book time with QR code in your room)

7 of 42

7

8 of 42

Center introductions

9 of 42

RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion

10 of 42

Psychology

Informatics

Musicology

11 of 42

Psychology

Informatics

Musicology

techno-logy

arts, crafts, tools

the study of

mind

pyscho-logy

music-o-logy

embodied

12 of 42

Psychology

Informatics

Musicology

RITMO aims to expand our understanding of rhythm as a fundamental property of human life.

13 of 42

Psychology

Informatics

Musicology

Rhythm

14 of 42

Rhythm

Psychology

Informatics

Musicology

15 of 42

Structure &

Aesthetics

Interaction & Pleasure

Interaction & Robotics

Structure &

Cognition

16 of 42

Nanette Nielsen

Jonna Vuoskoski

Kyrre Glette

Jim Tørresen

Tor Endestad

Anne-Kristin Solbakk

Bruno Laeng

Rainer Polak

Ragnhild Brøvig

Alexander Refsum Jensenius

Anne Danielsen

17 of 42

18 of 42

Bobler

19 of 42

20 of 42

21 of 42

22 of 42

22

23 of 42

23

MMBB

24 of 42

24

OUR MISSION

To build a comprehensive, neurocognitive model of music through the life span and in health and disease

To understand the multimodal mechanisms behind the effects of music

25 of 42

WP1

Multimodal Mechanisms of Music

How does music cognition and behavior function across life and in health and disease?

WP2

Music and Development

How can music support positive development and prevent adverse development?

WP3

Music and Rehabilitation

How can music aid functioning and recovery in mental and neurological illnesses?

theory

data collection

data analysis

effect of music-based interventions
auditory, cognitive, language skills
emotional self-regulation
social interaction

novel music-based tools and interventions

effect of music-based interventions
mental and neurological illnesses
emotional, cognitive, social motor functioning

novel optimized rehabilitation methods

interlinks of musical modalities
variation with age
effect of disorders

measurement batteries
naturalistic protocols
analysis methods

We have divided the work into three thematic work packages that comprise a total of thirteen scientific modules

•WP1 aims to resolve the link between different modalities of musical action and their variation across individuals, age groups and disorders

and to develop measurement batteries and protocols for music study as well as methods for analysis of multimodal musical data

•WP2 investigates the effect of music-based interventions on skill development, self-regulation, and social interaction and prevention of unfavourable trajectories in life and develops music-based tools and interventions for a range of target groups, such as autistic and dyslexic children

•WP3 delves into the multimodal effects of music-based interventions in neurological and mental illnesses, and introduce novel optimized rehabilitation methods

•The WPs are bound together by common theoretical assumptions about human musical functioning as well as common data collection protocols and data analysis methods

26 of 42

26

27 of 42

Principal Investigators

27

Suvi Saarikallio

music and emotions

music and wellbeing

Jaakko Erkkilä

music therapy

psychotherapy

Teija Kujala

cognitive neuroscience

language, music and brain

Petri Toiviainen

music cognition

music information science

director

subproject leader

Teppo Särkämö

neuropsychology

music rehabilitation

vice-director

subproject leader

Minna Huotilainen

music and education

music and neuroplasticity

subproject leader

28 of 42

28

Assoc. Prof. Esa Ala-Ruona (JyU)

Assessment and evaluation & meaning making in multimodal music therapy

Ass. Prof. Martín Hartmann (JyU)

Computational modelling of multimodal interaction in music and dance contexts

Senior Researcher Marc Thompson (JyU)

Embodiment studies focusing on creativity in improvised music performance

University Lecturer Tanja Linnavalli (UH)

The effects of music intervention on children’s social-emotional development

Senior Researcher Geoff Luck (JyU)

Rhythm, aging, well-being, embodied cognition, groove, movement

Research Director Mari Tervaniemi (UH)

Speech and music and their interaction in the learning brain

29 of 42

29

Markku Pöyhönen

MMBB coordinator

30 of 42

Multimodal measurement batteries & data set

30

brain

morphometry

structural

connectivity

activation

(music task & rest)

functional

connectivity

MMBB Brain Battery

basic

hearing

perception &

memory

rhythmic

timing

singing

production

musical

movement

musical

emotions

MMBB Music Battery

?

N = 2000

N = 500

5 yrs.

90 yrs.

31 of 42

Link to MMBB Music Battery

31

mmbb.fi

32 of 42

32

mmbb.fi

33 of 42

Peter Vuust�Director of Center for Music In the Brain (MIB)

Professor at the Royal Academy of Music, Aarhus, Denmark

Professor at Aarhus University

�PhD. in neuroscience, MSc. In math, French and music

Bassist/composer

Music in the Brain

34 of 42

Center for Music in the Brain

Elvira Brattico

Morten Kringelbach

Peter Vuust

Peter Keller

Andrea Ravignani

Kira Vibe Jespersen

Massimo Lumaca

Leonardo Bonetti

Boris Kleber

35 of 42

MIB mission!

MIB aims to address the dual questions of how music is processed in the brain and how this can inform our understanding of fundamental principles behind brain functioning.

MIB combines neuroscientific, musicological and psychological research in music perception, action, emotion and learning with the potential to test prominent theories of brain function and to influence the way we play, teach, use and listen to music.

36 of 42

Music In the Brain (MIB)

DNC - Danish Neuroscience Center

MR / fMRI

PET

MEG

EEG

RAMA

Location and technologies

DNC: offices, seminar rooms, auditorium, experimental facilities, other groups (CFIN, MINDLAB, PET Center, Clinical research groups etc.). Everything is running and good lab technicians are at hand.

Unique possibility med import disse people and make it a world leading center. As succesful unlike his center we have all of these techn.

New developments:

Organization:

We have secured Bjørn Petersens position and research project with musical training of cochlear implantees for at least three more years, by external funding
We have planned a new project on modelling aspects of the predictive coding hypothesis of music in a collaboration with the computational music lab at Goldsmiths College of Music (Geraint Wiggins and Marcus Pierce), and have gotten funding for a PhD student (Niels Christian Hansen, ”tell the story”).
Elvira will move to Aarhus if we get funding for her.

Of the many different new developments in our group the Mufe paradigm that I presented at the Neuroscience and Music conference in Edinburgh, is getting to be a big story at the moment within our field since we for the first time, has managed to create a music sounding MMN paradigm, which can distinguish between musicians of different styles.
We have begun a new collaboration on studying the auditory perception in amusic with Lauren Stewart and Elvira Brattico using our new Mufe paradigm.
Using the same paradigm, we are planning a project in which we want to scan the two big orchestras located in the music house: Klüver’s Big Band and Aarhus Symphoni orchestra.

37 of 42

Predictive coding of music (PCM)

Matthews et al, J. Cogn, 2023

Vuust et al, NRN, 2022

Koelsch, Vuust & Friston, TICS, 2019

Vuust, 2019

Vuust, 2018

Vuust & Witek 2014

Gebauer, Kringelbach & Vuust , 2013

Vuust et al., 2009

Vuust & Frith, 2008

3/4 or 4/4 ?

Precision-weighted prediction error

So this is the key idea of PCM, that your brain has an internal model (for instance the 4/4 meter, depending on where you are from) and the brain evaluate the incoming stimuli (e.g. the 3/4 meter), to compute the probability of its model given the input, by processing precision-weighted prediction error throughout the hierarchical brain - and that this process underlies perception, action, emotion and learning - which is what we are studying at MIB.

In my opinion the key element when we think about how rhythm is processed by the brain the relation between rhythm and meter or in other words the incoming stimulus and the predictive model provided by the brain.

We have in a series of papers suggested that the predictive coding theory, proposed by Karl Friston and colleagues (among others) as the fundamental principles by which the brain perceives and learn about the world, may serve as a very useful framework for understanding how music groove affects the brain. The general idea behind this theory is that the basic problem for the brain is to determine what is the cause of its sensory inputs, and it does so by comparing its internal model (or its prediction of the near future) to the incoming stimulus or more plainly to calculate the probability that its predictive model is correct given the sensory input. If there is a discrepancy between the input and the model it leads to a prediction error that the brain then tries to minimize at different hierarchical levels of the brain networks and this process leads to perception and learning.

Music provides an ideal and simple setting for investigating the predictive coding hypothesis.

Music

Is Anticipatory in nature
Is Stripped from concrete meaning (more or less, you can at least make very simple experiments using music)
Is An online communication system
Involves Learning

38 of 42

Different predictive frameworks

Tonality

Meter

Vuust et al, Nature Rev. Neu., 2022

39 of 42

False intros

Tina Dickow: “Warm Sand”

“Für Elise”: D-minor and 4/4

“Warm sand”: F#-minor and 6/8

Doobie Brothers: “Minute by Minute”

The Beatles: “Drive My Car”

40 of 42

Making meaning of music – MIB 2.0

Refining and developing Predictive Coding of Music (PCM)

New multimodal theme

Multimodal predictive coding
Singing as a model for predictive coding of auditory-motor coupling

New music interactions theme

Interpersonal synchronization
Social entrainment
Improvisation and communication

New meaning of music theme

Cultural transmission of music
Learning to find meaning in complex music
Making meaning of music in altered states of consciousness

Clinical applications of music

Music education applications

41 of 42

Vuust et al, NRN 2022

Predictive coding in musical interaction

42 of 42

Peter Keller

Andrea Ravignani

Boris Kleber

Tomas Matthews

Kira Vibe Jespersen

Niels trusbak

Victor Pando

Jan Stupacher

Sander Miralles

Cecilie Møller

Mathias Klarlund

Olivia Foster

Van der Elst

Alberte Seeberg

Gemma Fernandéz

Rubio

Bjørn Petersen

Full/associate professors

Assistent professors/postdocs

PhDS

MIB (total): N=32 +

Niels Christian Hansen,

David Quiroga,

& Anna Zamm

Massimo Lumaca

Pelle De Deckere

Ana Teresa Queiroga

Rebecca Scarratt

MIB Scientific Staff

Leonardo Bonetti

Athanasia Kontouli

Silvia Genovese

Paul Maublanc

Elvira Brattico

Morten Kringelbach

Peter Vuust

Anna Zamorano

Marie Dahlstrøm

Signe Hagner

Tina Bach Aaen

Hella Kastbjerg