1 of 17

AI Society

AI Society

What is a neural network

2 of 17

INPUT LAYER

OUTPUT LAYER

HIDDEN LAYERS

3 of 17

LEGAL?

4 of 17

LEGAL?

5 of 17

ZOOM IN

6 of 17

2 Parts: Summation and Activation

∑

σ

7 of 17

Activation Functions

8 of 17

ReLU

(The one we will use in this

tutorial)

9 of 17

Sigmoid

(The one she tells you not to worry about)

10 of 17

Alright, let’s solve a problem.

Input A

Input B

Output

1

1

0

1

0

1

0

1

1

0

0

0

11 of 17

XOR

1

1

0

12 of 17

XOR

1.0

-2.0

1.0

1.0

1.0

13 of 17

XOR

1.0

-2.0

1.0

1.0

1.0

-1.0

14 of 17

XOR

1.0

-2.0

1.0

1.0

1.0

-1.0

1

1

15 of 17

XOR

1.0

-2.0

1.0

1.0

1.0

-1.0

1

1

16 of 17

XOR

1.0

-2.0

1.0

1.0

1.0

-1.0

1

1

1

max(0, 1*1 + 1*1 + -1)

17 of 17

XOR

1.0

-2.0

1.0

1.0

1.0

-1.0

1

1

1

0

max(0, 1*1 + 1*1 + -2.0*1 + 0)