1 of 24

Interactive Example-Based Terrain Authoring with Conditional

Generative Adversarial Networks

Scientific Paper Presentation

2 of 24

Interactive Example-Based Terrain Authoring with Conditional Generative Adversarial Networks

3 of 24

Interactive Example-Based Terrain Authoring with Conditional Generative Adversarial Networks

4 of 24

Interactive Example-Based Terrain Authoring with Conditional Generative Adversarial Networks

5 of 24

Example session

6 of 24

Interactive Example-Based Terrain Authoring with Conditional Generative Adversarial Networks

  • GAN
    • deep neural network
    • image generation
    • trained as a game between generator and discriminator
  • cGAN
    • uses additional input to direct the generation

7 of 24

Training

8 of 24

Overview

9 of 24

Synthesizers

  • Sketch-to-Terrain
    • creates terrain from a sketch containing ridges, rivers, altitude cues
  • Levelset-to-Terrain
    • turns a binary levelset image into a terrain
  • Eraser
    • removes a user-specified part of the terrain and completes it
  • Erosion
    • transforms an input terrain into the corresponding eroded terrain

10 of 24

Sketch-to-Terrain

  • rivers - simulating water flow
  • crest lines - rivers inverted
  • altitude cues - points where water accumulated

11 of 24

Sketch-to-Terrain training set

12 of 24

Synthesizers

  • Sketch-to-Terrain
    • creates a terrain from a sketch containing ridges, rivers, altitude cues
  • Levelset-to-Terrain
    • turns a binary levelset image into a terrain
  • Eraser
    • removes a user-specified part of the terrain and completes it
  • Erosion
    • transforms an input terrain into the corresponding eroded terrain

13 of 24

Levelset-to-Terrain

  • thresholding the altitude

14 of 24

Synthesizers

  • Sketch-to-Terrain
    • creates a terrain from a sketch containing ridges, rivers, altitude cues
  • Levelset-to-Terrain
    • turns a binary levelset image into a terrain
  • Eraser
    • removes a user-specified part of the terrain and completes it
  • Erosion
    • transforms an input terrain into the corresponding eroded terrain

15 of 24

Eraser

  • adding a few discs that represent the missing parts

16 of 24

Synthesizers

  • Sketch-to-Terrain
    • creates a terrain from a sketch containing ridges, rivers, altitude cues
  • Levelset-to-Terrain
    • turns a binary levelset image into a terrain
  • Eraser
    • removes a user-specified part of the terrain and completes it
  • Erosion
    • transforms an input terrain into the corresponding eroded terrain

17 of 24

Erosion

  • meta simulation

18 of 24

Amplification

  • small scale details can be added to large-scale terrain
  • using a super-resolution technique

19 of 24

Interactive authoring response times

20 of 24

Training times

21 of 24

Inexperienced user session

22 of 24

Professional artist session

23 of 24

24 of 24

Feedback

  • great read
  • lots of illustrations

  • deep learning knowledge required
  • content gets repetitive