1 of 57

1

Instructor: Ercan Atam

Institute for Data Science & Artificial Intelligence

​

Course: DSAI 525– Time Series and Forecasting with Machine Learning

��������������������Lecture 6 � � Some Nonlinear Time Series Models & Optimal Linear Predictors�

2 of 57

2

List of contents for this lecture

​

​

  • NARX, NARMAX, HW model structures as nonlinear time series models

​

  • LPV-SI and recursive SI as advanced SI approaches

​

  • Optimal linear predictors.

​

  • Transformation of polynomial models to state-space form

​

​

3 of 57

3

Nonlinear ARX (NARX) (1)

4 of 57

4

Nonlinear ARX (NARX) (2)

5 of 57

5

Nonlinear ARMAX (NARMAX)

6 of 57

6

Remarks

7 of 57

7

Hammerstein-Wiener (HW) model (1)

8 of 57

8

Hammerstein-Wiener (HW) model (2)

9 of 57

9

Hammerstein-Wiener (HW) model (3)

10 of 57

10

SI for linear parameter-varying (LPV) models (1)

11 of 57

11

SI for linear parameter-varying (LPV) models (2)

12 of 57

12

​

SI for linear parameter-varying (LPV) models (3)

​

13 of 57

13

​

SI for linear parameter-varying (LPV) models (4)

​

14 of 57

14

​

Examples on LPV/quasi-LPV modelling (1)

​

15 of 57

15

​

Examples on LPV/quasi-LPV modelling (2)

​

16 of 57

16

​

Examples on LPV/quasi-LPV modelling (3)

​

17 of 57

17

LPV input-output model example

18 of 57

18

Some remarks on LPV-SI

19 of 57

19

Recursive SI

20 of 57

20

Remarks on recursive SI (1)

21 of 57

21

Remarks on recursive SI (2)

22 of 57

22

Optimal linear predictors (1)

23 of 57

23

Optimal linear predictors (2)

24 of 57

24

Optimal linear predictors (3)

25 of 57

25

Optimal linear predictors (4)

26 of 57

26

Optimal linear predictors (5)

27 of 57

27

One-step ahead prediction error calculations for some models (1)

28 of 57

28

One-step ahead prediction error calculations for some models (2)

29 of 57

29

One-step ahead prediction error calculations for some models (3)

30 of 57

30

One-step ahead prediction error calculations for some models (4)

31 of 57

31

One-step ahead prediction error calculations for some models (5)

32 of 57

32

One-step ahead prediction error calculations for some models (6)

33 of 57

33

One-step ahead prediction error calculations for some models (7)

34 of 57

34

Optimal N-step ahead linear predictor (1)

35 of 57

35

Optimal N-step ahead linear predictor (2)

36 of 57

36

Optimal N-step ahead linear predictor (3)

37 of 57

37

Optimal N-step ahead linear predictor (4)

38 of 57

38

Optimal N-step ahead linear predictor (5)

39 of 57

39

Example (1)

40 of 57

40

Example (2)

41 of 57

41

Transformation of polynomial I/O LTI models to state-space form (1)

42 of 57

42

Transformation of polynomial I/O LTI models to state-space form (2)

43 of 57

43

Transformation of polynomial I/O LTI models to state-space form (3)

44 of 57

44

Transformation of polynomial I/O LTI models to state-space form (4)

45 of 57

45

Transformation of polynomial I/O LTI models to state-space form (5)

46 of 57

46

Transformation of polynomial I/O LTI models to state-space form (6)

47 of 57

47

Transformation of polynomial I/O LTI models to state-space form (7)

48 of 57

48

Transformation of polynomial I/O LTI models to state-space form (8)

49 of 57

49

Transformation of polynomial I/O LTI models to state-space form (9)

50 of 57

50

Optimal prediction for state-space models in innovation form (1)

51 of 57

51

Optimal prediction for state-space models in innovation form (2)

52 of 57

52

Optimal prediction for state-space models in innovation form (3)

53 of 57

53

Appendix: An alternative method for derivation of one-step ahead predictor (1)

54 of 57

54

Appendix: An alternative method for derivation of one-step ahead predictor (2)

55 of 57

55

Appendix: An alternative method for derivation of one-step ahead predictor (3)

56 of 57

56

Appendix: An alternative method for derivation of one-step ahead predictor (4)

57 of 57

References �(utilized for preparation of lecture notes or MATLAB code)

57

​

  • Chapters 4, 9, 17 of “Principles of System Identification: Theory and Practice”, Arun K. Tangirala, CRC Press, 2014.

​

​

​

​

​