1 of 9

Backpropagation and Automatic Differentiation

2 of 9

Backpropagation and Automatic Differentiation

3 of 9

Automatic Differentiation

  • Automatic differentiation applies a series of elementary arithmetic operations, e.g., addition and multiplication and elementary functions, e.g., sin; cos; exp; log.

​

​

4 of 9

Automatic Differentiation

  • Automatic differentiation applies a series of elementary arithmetic operations, e.g., addition and multiplication and elementary functions, e.g., sin; cos; exp; log.
  • By applying the chain rule to these operations, the gradient of quite complicated functions can be computed automatically.

​

5 of 9

Automatic Differentiation

  • Automatic differentiation applies a series of elementary arithmetic operations, e.g., addition and multiplication and elementary functions, e.g., sin; cos; exp; log.
  • By applying the chain rule to these operations, the gradient of quite complicated functions can be computed automatically.

​

6 of 9

Automatic Differentiation

7 of 9

Automatic Differentiation

8 of 9

Automatic Differentiation

9 of 9

Automatic Differentiation