1 of 11

Navigating with grid-like representations in artificial agents

Vit Listik

17.5.2018

2 of 11

Facts

​

​

3 of 11

Self localization

  • Movement related velocity signals

https://storage.googleapis.com/deepmind-live-cms/documents/Grid%2520cells%2520animation.gif

4 of 11

Grid cells

  • Vector-based navigation
  • Based on mammal brain
    • Grid cells - Reference biology paper (Cueva and Wei 2005) (Nobel price 2014)
  • Place of field

5 of 11

Navigation task

  • Navigate to goal
    • Generated environment
    • Doors
  • Agent architecture
    • Grid network
    • Larger network
    • Reinforcement learning

6 of 11

Agent

  • Vision module (CNN)
  • Grid cell
  • Actor critic network

7 of 11

8 of 11

Performance

  • Super human performance (compared to professional game players)
  • Grid cells are essential

9 of 11

​

​

https://storage.googleapis.com/deepmind-live-cms/documents/Vector-based%2520navigation%2520animation.gif

10 of 11

Next steps

  • neuroscience ~ AI
  • Sound processing in brain
  • Limbs
  • Some code will be open-sourced (not all)

11 of 11

Resources