1 of 76

The role of variability in

perceived rhythmic complexity

Leigh VanHandel

University of British Columbia

leigh.vanhandel@ubc.ca

2 of 76

2

3 of 76

Rhythmic complexity

Syncopation

    • Gomez, Melvin, Rappaport & Toussaint 2005
    • Longuet-Higgins and Lee 1984

Density

    • Eerola, Himberg, Toivianinen & Louhivuori 2006
    • Temperley 2019

Variability

    • Grabe & Low 2002
    • Patel & Daniele 2003
    • VanHandel 2005, 2006, 2021, 2023

4 of 76

Rhythmic complexity

Variability: nPVI – normalized Pairwise Variability Index

Density – number of events per measure

density = 4

density = 10

variability = 0

variability = 55.6

5 of 76

The story so far …. Experiment 1

Context

400 ms

(150 bpm)

No context

Context

333 ms

(180 bpm)

No context

Context

533 ms

(113 bpm)

No context

Context

666 ms

(90 bpm)

No context

Context

800 ms

(75 bpm)

No context

Context

933 ms

(64 bpm)

No context

6 of 76

The story so far …. Experiment 1

7 of 76

The story so far …. Experiment 1

400 ms

(150 bpm)

800 ms

(75 bpm)

density

syncopation

8 of 76

The story so far …. Experiment 2

Context

400 ms

(150 bpm)

No context

Context

333 ms

(180 bpm)

No context

Context

533 ms

(113 bpm)

No context

Context

666 ms

(90 bpm)

No context

Context

800 ms

(75 bpm)

No context

Context

933 ms

(64 bpm)

No context

9 of 76

The story so far …. Experiment 2

Context

400 ms

(150 bpm)

No context

Context

333 ms

(180 bpm)

No context

Context

533 ms

(113 bpm)

No context

Context

666 ms

(90 bpm)

No context

Context

800 ms

(75 bpm)

No context

Context

933 ms

(64 bpm)

No context

Fast Context (FC) group

Slow Context (SC) group

Fast No Context (FN) group

Slow No Context (SN) group

10 of 76

The story so far …. Experiment 2

*

*

*

**

11 of 76

The story so far …. Experiment 2

*

533

533

666

666

12 of 76

The story so far …. Experiment 2

400 ms

(150 bpm)

800 ms

(75 bpm)

density

syncopation

13 of 76

The story so far …. Experiment 2

14 of 76

Experiment 3

Context

400 ms

(150 bpm)

No context

Context

333 ms

(180 bpm)

No context

Context

533 ms

(113 bpm)

No context

Context

666 ms

(90 bpm)

No context

Context

800 ms

(75 bpm)

No context

Context

933 ms

(64 bpm)

No context

Fast group

Slow group

15 of 76

Experiment 3

Context

No context

Context

No context

Context

No context

Context

No context

Context

No context

Context

No context

Fast group = 864 stimuli

Slow group = 864 stimuli

6

7

8

9

8008

11,440

12,870

11,440

50

56

56

54

Possible rhythmic patterns

Selected rhythmic patterns

Total # of rhythmic patterns

216

x 4 tempos per group

16 of 76

Experiment 3

Context

No context

Context

No context

Context

No context

Context

No context

Context

No context

Context

No context

Fast group = 864 stimuli

Slow group = 864 stimuli

Fast group – 273 participants

Slow group – 235 participants

508 usable responses

150

150

956 participants total

17 of 76

Experiment 3

Context

No context

Context

No context

Context

No context

Context

No context

Context

No context

Context

No context

Fast group = 864 stimuli

Slow group = 864 stimuli

Fast group – 273 participants

Slow group – 235 participants

508 usable responses

150

150

956 participants total

18 of 76

Experiment 3

Context

No context

Context

No context

Context

No context

Context

No context

Context

No context

Context

No context

Fast group = 864 stimuli

Slow group = 864 stimuli

Fast group – 273 participants

Slow group – 235 participants

508 usable responses

150

150

956 participants total

19 of 76

Experiment 3

Context

No context

Context

No context

Context

No context

Context

No context

Context

No context

Context

No context

Fast group = 864 stimuli

Slow group = 864 stimuli

Fast group – 273 participants

Slow group – 235 participants

508 usable responses

150

150

956 participants total

20 of 76

Experiment 3

21 of 76

Experiment 3

533

533

666

666

*

*

22 of 76

Experiment 3

23 of 76

Experiment 3

24 of 76

Experiment 3

25 of 76

Experiment 3

F

F

S

S

F

F

S

S

26 of 76

Experiment 2 -- reminder

27 of 76

Experiment 3

28 of 76

Experiment 3

Audience participation time: what’s going on here?

29 of 76

Experiment 3

Audience participation time: what’s going on here?

30 of 76

Conclusions

30

  • Perceived rhythmic complexity is strongly tempo dependent.

  • Relative tempos affects perceived complexity ratings.

  • Syncopation and density were both important factors in perceived complexity ratings.

    • Density is a stronger factor at faster tempi and decreases for slower tempi, whereas syncopation is a stronger factor at the slower tempi.

    • Variability plays a small but significant role in perceived complexity, but is still presenting complications in interpretation.

31 of 76

Acknowledgements

31

Research assistants:

Zachary Lookenbill

Gerardo Lopez

Ryan Jones�Nathalie Nordan

UBC VanLab research assistants:

Claire Brillon

Tania Cheng

Yewon Hong

Rae Jourard

CC Liang and CC Liang’s dad

Leah McNeil

Risa Murakami

Lola Quinn

Jay Villanueva

Claudia Wu

Lily Xie

32 of 76

32

33 of 76

The role of variability �in perceived rhythmic complexity

Leigh VanHandel

University of British Columbia

leigh.vanhandel@ubc.ca

34 of 76

Tempo determination

The real-time act or process of determining what an

appropriate tempo is for an unfamiliar piece of music,

based on musical characteristics that act as cues.

34

35 of 76

Tempo determination

35

Preferred tempo

Tempo memory

Tempo discrimination

36 of 76

Rhythmic complexity

Complexity metrics

Povel & Essens 1985

Essens 1990

Shmulevich & Povel 2000

Thul & Toussaint 2008

Syncopation

Gomez, Melvin, Rappaport

& Toussaint 2005

Longuet-Higgins and Lee 1984

Variability

Grabe & Low 2002

Patel & Daniele 2003

VanHandel 2005, 2006, 2021

Density

Eerola, Himberg, Toivianinen & Louhivuori 2006

Temperley 2019

37 of 76

Musical cues

37

Melodic

Rhythmic

Harmonic

Sonic

  • Ornamentation
  • Contour change
  • Interval size
  • Attack rate
  • Complexity
  • Syncopation
  • Change rate
  • Progressions
  • Repetition
  • Register
  • Timbre
  • Loudness

38 of 76

Rhythmic complexity

38

Complexity

Complexity

Povel & Essens 1985

Essens 1990

Shmulevich & Povel 2000

Thul & Toussaint 2008

Syncopation

Gomez, Melvin, Rappaport & Toussaint 2005

Longuet-Higgins and Lee 1984

Variability

Grabe & Low 2002

Patel & Daniele 2003

VanHandel 2005, 2006, 2021

Density

Eerola, Himberg, Toivianinen & Louhivuori 2006

Temperley 2019

39 of 76

Context vs. no-context

39

No context

Context

40 of 76

Experiment 1: Methods

Subjects used an Arduino spin wheel controller to manipulate the tempo of the looping rhythmic patterns in real time. They were asked to find the “right” tempo for that rhythmic pattern, thus determining the tempo from a continuous tempo spectrum.

Instructions:

“You will hear a short rhythm that will continuously repeat with no break. You will use this spin wheel to control the speed of the rhythm until you think you have found the ‘right’ speed for the rhythm. You should listen to the first few seconds of the rhythm before starting to manipulate the tempo.”

40

41 of 76

Experiment 1: Methods

The real time tempo manipulation is controlled by a phase vocoder patch in the Pure Data environment, interfaced with a custom experimental program.

41

42 of 76

Tempo determination �rhythm experiment

400 ms

(150 bpm)

800 ms (75 bpm)

Context

No context

Context

No context

Starting Tempos

Beat unit at 400 ms IOI (150 bpm) or 800 ms IOI (75 bpm)

Context

With metrical context, and without

Conditions:

43 of 76

Rhythm Experiment 1

43

35 participants drawn from university research pool

Non–musicians:

  • GMSI General Sophistication score: 44-68%, average 58%

Tasks:

  • Tempo determination tasks
  • Tapping task
  • Perceived complexity rating task

44 of 76

Rhythm Experiment 1: Stimuli

44

30 rhythmic stimuli:

  • 6 rhythms drawn from Povel & Essens 1985
  • 24 original rhythms, composed to represent a variety of variability, density, and syncopation

Recorded using a percussive sample from Ableton Live that allowed for real-time tempo changes.

45 of 76

Average determined tempo

45

Slower

(75 bpm)

Faster

(150 bpm)

*

*

46 of 76

Other rhythmic characteristics

46

density

variability

syncopation

overall

.650**

-.286**

400 ms

together

.710**

-.311*

no context

.907**

-.408*

context

.664**

800 ms

together

.446**

no context

.786**

context

.457*

-.434*

** Correlation is significant at the 0.01 level

* Correlation is significant at the 0.05 level

47 of 76

Effect of density

47

48 of 76

Complexity ratings: Experiment 1

48

Context

400 ms

(150 bpm)

No context

Context

333 ms

(180 bpm)

No context

Context

533 ms

(113 bpm)

No context

Context

666 ms

(90 bpm)

No context

Context

800 ms

(75 bpm)

No context

Context

933 ms

(64 bpm)

No context

49 of 76

Rhythm Experiment 1: Stimuli

49

50 of 76

Complexity ratings

50

51 of 76

Complexity and rhythmic characteristics

51

density

variability

syncopation

overall

.604**

.500**

400 ms

no context

.809**

.411*

800 ms

no context

.403*

.638**

** Correlation is significant at the 0.01 level

* Correlation is significant at the 0.05 level

52 of 76

Complexity ratings: Experiment 2

52

481 participants (330 F, 118 M, 33 Other) drawn from university research pool

  • Mean age = 22.6 years, self-reported with normal hearing

Generally non–musicians (GMSI range 33.3–80.9, average 58.9)

Task:

  • Perceived complexity rating task

53 of 76

Complexity ratings: Experiment 2

53

12 stimuli drawn from Experiment 1:

54 of 76

Context vs. no-context

54

Context

No context

55 of 76

Complexity ratings: Experiment 2

55

Context

400 ms

(150 bpm)

No context

Context

333 ms

(180 bpm)

No context

Context

533 ms

(113 bpm)

No context

Context

666 ms

(90 bpm)

No context

Context

800 ms

(75 bpm)

No context

Context

933 ms

(64 bpm)

No context

density

syncopation

56 of 76

Complexity ratings: Experiment 2

56

Context

400 ms

(150 bpm)

No context

Context

333 ms

(180 bpm)

No context

Context

533 ms

(113 bpm)

No context

Context

666 ms

(90 bpm)

No context

Context

800 ms

(75 bpm)

No context

Context

933 ms

(64 bpm)

No context

57 of 76

Complexity ratings: Experiment 2

57

Context

400 ms

(150 bpm)

No context

Context

333 ms

(180 bpm)

No context

Context

533 ms

(113 bpm)

No context

Context

666 ms

(90 bpm)

No context

Context

800 ms

(75 bpm)

No context

Context

933 ms

(64 bpm)

No context

Fast Context (FC) group

Slow Context (SC) group

Fast No Context (FN) group

Slow No Context (SN) group

58 of 76

Complexity ratings: Experiment 2

58

*

*

*

**

59 of 76

Complexity ratings: Experiment 2

59

*

533

533

666

666

60 of 76

Complexity ratings: Experiment 2

60

Tempo

Variability

Density

Syncopation

333

-.022

.475**

.399**

400

-.034

.470**

.369**

533

.002

.368**

.364**

Fast

-.019

.401**

.367**

Slow

.022

.338**

.363**

666

.019

.328**

.343**

Fast

.010

.341**

.350**

Slow

.027

.315**

.335**

800

.051**

.242**

.334**

933

.047*

.230**

.316**

Correlations with perceived complexity and rhythmic characteristics

* Correlation is significant at the 0.05 level. ** Correlation is significant at the 0.01 level.

61 of 76

Complexity ratings: Experiment 2

61

62 of 76

Complexity ratings: Experiment 2

62

63 of 76

Complexity ratings: Experiment 2

63

64 of 76

Conclusions – rhythm

64

Tempo determination

Perceived complexity

Density

X

X

Syncopation

X

Variability

X

65 of 76

Distribution of �determined tempo

65

66 of 76

Rhythm Experiment 1

66

Two starting tempo conditions:

800 ms (75 bpm) or 400 ms (150 bpm)

Task 3 – rating

Perceptual complexity rating at original starting tempo on a scale of 1 (not complex) to 6 (complex).

03

Task 2 (context)

Rhythmic stimuli alternates with four isochronous pulses; otherwise same procedure as Task 1.

02

Task 1 (no context)

Rhythmic stimuli plays on loop, participant manipulates tempo until it feels “correct.”

Rhythm plays on loop at determined tempo; participant taps what they felt was the beat for 20 taps.

01

67 of 76

Tapping to the beat

67

Tempo determination task

Tapping task

*

 

 

 

 

 

 

 

*

 

 

 

 

 

 

 

*

 

 

 

 

 

 

 

*

 

 

 

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

Pulse level

Subdivision

Hypermeter

68 of 76

Tapping to the beat

68

Tempo determination task

Tapping task

*

 

 

 

 

 

 

 

*

 

 

 

 

 

 

 

*

 

 

 

 

 

 

 

*

 

 

 

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

Pulse level

Subdivision

Hypermeter

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

75 bpm

37.5 bpm

150 bpm

69 of 76

Tapping to the beat

69

Tempo determination task

Tapping task

*

 

 

 

 

 

 

 

*

 

 

 

 

 

 

 

*

 

 

 

 

 

 

 

*

 

 

 

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

Pulse level

Subdivision

Hypermeter

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

160 bpm

80 bpm

320 bpm

70 of 76

Tapping to the … beat?

70

Tempo determination task

Tapping task

*

 

 

 

 

 

 

 

*

 

 

 

 

 

 

 

*

 

 

 

 

 

 

 

*

 

 

 

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

Pulse level

Subdivision

Hypermeter

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

 

*

 

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

160 bpm

80 bpm

320 bpm

71 of 76

Tapping ratios

71

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

 

*

*

 

 

*

 

 

*

 

 

*

 

 

*

 

 

*

 

 

*

 

 

*

 

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

*

 

*

*

*

 

*

*

*

*

*

*

 

*

*

 

*

 

 

*

beat unit

1:1 ratio (1)

1:2 ratio (.5)

2:1 ratio (2)

…?

72 of 76

Tapping ratio by starting tempo and context

72

**

** Correlation is significant at the 0.01 level

* Correlation is significant at the 0.05 level

73 of 76

Tapping ratio by starting tempo and context

73

**

** Correlation is significant at the 0.01 level

* Correlation is significant at the 0.05 level

74 of 76

Tapping ratio and rhythmic characteristics

74

density

variability

syncopation

400 ms

together

no context

-.387*

context

800 ms

together

-.271*

no context

-.419*

context

** Correlation is significant at the 0.01 level

* Correlation is significant at the 0.05 level

75 of 76

Tempo project – �Overall conclusions

75

  • Melodic and rhythmic characteristics do play a role in tempo determination.

  • Starting tempo is important. plays an enormous role in tempo perception, and needs to be accounted for in future studies.

  • So much for free will …

76 of 76

Future directions

76

  • Future directions for the tempo project include following up on questions emerging from rhythm study, studying harmonic and timbral characteristics, and creating a model for how they interact.

  • Online version of experiment forthcoming, with a primary goal to extend to non-WEIRD populations.*

* Henrich 2020