1 of 10

Generate. Interpolate. Orchestrate.

Group 3A Members

Laura Ibanez

António Ramires

Seunghun Lee

Satvik Venkatesh

Anja Scheller

Ying Wang

CJ

Presenting & Live Demo

Laura & António

#AIxMUSIC20

2 of 10

Introduction

1940s

Rock Music

EDM

1980s

AI-esthetic

2020?

3 of 10

What’s AI-esthetic?

  • References to environmental sounds
  • Neural transfer

4 of 10

Key concepts

Existing music

Neural transfer

Source separation

Environmental sounds

AI-esthetic

5 of 10

Motivation

Turning everdays environmental sounds into before unheard soundscapes.

Changing the perception of our environment by breaking its patterns and transforming them into a new hearing experience by using AI technology.

Finding a new way to capture the unique atmosphere of a place, turning noises into instrumental sounds and by that creating an additional level of sensual experience.

6 of 10

Project Steps

Finding the right sources = field recordings from different environments

A day at the beach

Park scene

Construction work

7 of 10

Unmix the field recordings & create 4 separate stems for each

Vocals Drums Bass Other

8 of 10

Using DDSP Timbre Transfer* (pre-trained and own trained models)

vocals -> violin

drums -> double bass

bass -> cello

other -> viola

Learnings: When training the models - quality beats quantity

*) Link: tba

9 of 10

“Recreating” the environment by using Mixer & Crossfader

https://soundscape-ai.netlify.app

10 of 10

Thank you for watching & listening!

#AIxMUSIC20