1 of 103

CHAPTER 6�LINEAR TRANSFORMATIONS

Elementary Linear Algebra

R. Larson (8 Edition)

6.1 Introduction to Linear Transformations

6.2 The Kernel and Range of a Linear Transformation

6.3 Matrices for Linear Transformations

6.4 Transition Matrices and Similarity

6.5 Applications of Linear Transformations

投影片設計製作者

淡江大學 電機系 翁慶昌 教授

2 of 103

CH 6 Linear Algebra Applied

Multivariate Statistics (p.304) Circuit Design (p.322)

Control Systems (p.314)

Population Age and Growth Distribution (p.331) Computer Graphics (p.338)

1/103

3 of 103

6.1 Introduction to Linear Transformations

  • Function T that maps a vector space V into a vector space W:

V: the domain of T

W: the codomain of T

Elementary Linear Algebra: Section 6.1, p.298

2/103

4 of 103

  • Image of v under T:

If v is in V and w is in W such that

Then w is called the image of v under T .

  • the range of T:

The set of all images of vectors in V.

  • the preimage of w:

The set of all v in V such that T(v)=w.

Elementary Linear Algebra: Section 6.1, p.298

3/103

5 of 103

  • Ex 1: (A function from R2 into R2 )

(a) Find the image of v=(-1,2). (b) Find the preimage of w=(-1,11)

Sol:

Thus {(3, 4)} is the preimage of w=(-1, 11).

Elementary Linear Algebra: Section 6.1, p.298

4/103

6 of 103

  • Linear Transformation (L.T.):

Elementary Linear Algebra: Section 6.1, p.299

5/103

7 of 103

  • Notes:

(1) A linear transformation is said to be operation preserving.

Addition in V

Addition in W

Scalar multiplication in V

Scalar multiplication in W

(2) A linear transformation from a vector space into itself is called a linear operator.

Elementary Linear Algebra: Section 6.1, p.299

6/103

8 of 103

  • Ex 2: (Verifying a linear transformation T from R2 into R2)

Pf:

Elementary Linear Algebra: Section 6.1, p.299

7/103

9 of 103

Therefore, T is a linear transformation.

Elementary Linear Algebra: Section 6.1, p.299

8/103

10 of 103

  • Ex 3: (Functions that are not linear transformations)

Elementary Linear Algebra: Section 6.1, p.300

9/103

11 of 103

  • Notes: Two uses of the term “linear”.

(1) is called a linear function because its graph is a line.

(2) is not a linear transformation from a vector space R into R because it preserves neither vector addition nor scalar multiplication.

Elementary Linear Algebra: Section 6.1, p.300

10/103

12 of 103

  • Zero transformation:
  • Identity transformation:
  • Thm 6.1: (Properties of linear transformations)

Elementary Linear Algebra: Section 6.1, p.300

11/103

13 of 103

  • Ex 4: (Linear transformations and bases)

Let be a linear transformation such that

Sol:

(T is a L.T.)

Find T(2, 3, −2).

Elementary Linear Algebra: Section 6.1, p.301

12/103

14 of 103

  • Ex 5: (A linear transformation defined by a matrix)

The function is defined as

Sol:

(vector addition)

(scalar multiplication)

Elementary Linear Algebra: Section 6.1, p.301

13/103

15 of 103

  • Thm 6.2: (The linear transformation given by a matrix)

Let A be an m×n matrix. The function T defined by

is a linear transformation from Rn into Rm.

  • Note:

Elementary Linear Algebra: Section 6.1, p.302

14/103

16 of 103

  • Ex 7: (Rotation in the plane)

Show that the L.T. given by the matrix

has the property that it rotates every vector in R2 counterclockwise about the origin through the angle θ.

Sol:

(polar coordinates)

r: the length of v

α:the angle from the positive x-axis counterclockwise to the vector v

Elementary Linear Algebra: Section 6.1, p.303

15/103

17 of 103

r:the length of T(v)

θ:the angle from the positive x-axis counterclockwise to

the vector T(v)

Thus, T(v) is the vector that results from rotating the vector v counterclockwise through the angle θ.

Elementary Linear Algebra: Section 6.1, p.303

16/103

18 of 103

  • Ex 8: (A projection in R3)

is called a projection in R3.

The linear transformation is given by

Elementary Linear Algebra: Section 6.1, p.304

17/103

19 of 103

  • Ex 9: (A linear transformation from Mm×n into Mn ×m )

Show that T is a linear transformation.

Sol:

Therefore, T is a linear transformation from Mm×n into Mn ×m.

Elementary Linear Algebra: Section 6.1, p.304

18/103

20 of 103

Key Learning in Section 6.1

  • Find the image and preimage of a function.
  • Show that a function is a linear transformation, and find a linear transformation.

19/103

21 of 103

Keywords in Section 6.1

  • function: 函數
  • domain: 論域
  • codomain: 對應論域
  • image of v under T: 在T映射下v的像
  • range of T: T的值域
  • preimage of w: w的反像
  • linear transformation: 線性轉換
  • linear operator: 線性運算子
  • zero transformation: 零轉換
  • identity transformation: 相等轉換

20/103

22 of 103

6.2 The Kernel and Range of a Linear Transformation

  • Kernel of a linear transformation T:

Let be a linear transformation

Then the set of all vectors v in V that satisfy is called the kernel of T and is denoted by ker(T).

  • Ex 1: (Finding the kernel of a linear transformation)

Sol:

Elementary Linear Algebra: Section 6.2, p.309

21/103

23 of 103

  • Ex 2: (The kernel of the zero and identity transformations)

(a) T(v) = 0 (the zero transformation )

(b) T(v) = v (the identity transformation )

  • Ex 3: (Finding the kernel of a linear transformation)

Sol:

Elementary Linear Algebra: Section 6.2, p.309

22/103

24 of 103

  • Ex 5: (Finding the kernel of a linear transformation)

Sol:

Elementary Linear Algebra: Section 6.2, p.310

23/103

25 of 103

Elementary Linear Algebra: Section 6.2, p.310

24/103

26 of 103

  • Thm 6.3: (The kernel is a subspace of V)

The kernel of a linear transformation is a subspace of the domain V.

Pf:

  • Note:

The kernel of T is sometimes called the nullspace of T.

Elementary Linear Algebra: Section 6.2, p.311

25/103

27 of 103

  • Ex 6: (Finding a basis for the kernel)

Find a basis for ker(T) as a subspace of R5.

Elementary Linear Algebra: Section 6.2, p.311

26/103

28 of 103

Sol:

Elementary Linear Algebra: Section 6.2, p.311

27/103

29 of 103

  • Corollary to Thm 6.3:
  • Range of a linear transformation T:

Elementary Linear Algebra: Section 6.2, p.311-312

28/103

30 of 103

  • Thm 6.4: (The range of T is a subspace of W)

Pf:

Elementary Linear Algebra: Section 6.2, p.312

29/103

31 of 103

  • Notes:
  • Corollary to Thm 6.4:

Elementary Linear Algebra: Section 6.2, p.312

30/103

32 of 103

  • Ex 7: (Finding a basis for the range of a linear transformation)

Find a basis for the range of T.

Elementary Linear Algebra: Section 6.2, p.313

31/103

33 of 103

Sol:

Elementary Linear Algebra: Section 6.2, p.313

32/103

34 of 103

  • Rank of a linear transformation T:VW:
  • Nullity of a linear transformation T:VW:
  • Note:

Elementary Linear Algebra: Section 6.2, p.313

33/103

35 of 103

  • Thm 6.5: (Sum of rank and nullity)

Pf:

Elementary Linear Algebra: Section 6.2, p.313

34/103

36 of 103

  • Ex 8: (Finding the rank and nullity of a linear transformation)

Sol:

Elementary Linear Algebra: Section 6.2, p.314

35/103

37 of 103

  • Ex 9: (Finding the rank and nullity of a linear transformation)

Sol:

Elementary Linear Algebra: Section 6.2, p.314

36/103

38 of 103

  • One-to-one:

Elementary Linear Algebra: Section 6.2, p.315

37/103

39 of 103

  • Onto:

(T is onto W when W is equal to the range of T.)

Elementary Linear Algebra: Section 6.2, p.315

38/103

40 of 103

  • Thm 6.6: (One-to-one linear transformation)

Pf:

Elementary Linear Algebra: Section 6.2, p.315

39/103

41 of 103

  • Ex 10: (One-to-one and not one-to-one linear transformation)

Elementary Linear Algebra: Section 6.2, p.315

40/103

42 of 103

  • Thm 6.7: (Onto linear transformation)
  • Thm 6.8: (One-to-one and onto linear transformation)

Pf:

Elementary Linear Algebra: Section 6.2, p.316

41/103

43 of 103

  • Ex 11:

Sol:

T:RnRm

dim(domain of T)

rank(T)

nullity(T)

1-1

onto

(a)T:R3R3

3

3

0

Yes

Yes

(b)T:R2R3

2

2

0

Yes

No

(c)T:R3R2

3

2

1

No

Yes

(d)T:R3R3

3

2

1

No

No

Elementary Linear Algebra: Section 6.2, p.316

42/103

44 of 103

  • Isomorphism:
  • Thm 6.9: (Isomorphic spaces and dimension)

Pf:

Two finite-dimensional vector space V and W are isomorphic if and only if they are of the same dimension.

Elementary Linear Algebra: Section 6.2, p.317

43/103

45 of 103

It can be shown that this L.T. is both 1-1 and onto.

Thus V and W are isomorphic.

Elementary Linear Algebra: Section 6.2, p.317

44/103

46 of 103

  • Ex 12: (Isomorphic vector spaces)

The following vector spaces are isomorphic to each other.

Elementary Linear Algebra: Section 6.2, p.317

45/103

47 of 103

Key Learning in Section 6.2

  • Find the kernel of a linear transformation.
  • Find a basis for the range, the rank, and the nullity of a linear transformation.
  • Determine whether a linear transformation is one-to-one or onto.
  • Determine whether vector spaces are isomorphic.

46/103

48 of 103

Keywords in Section 6.2

  • kernel of a linear transformation T: 線性轉換T的核空間
  • range of a linear transformation T: 線性轉換T的值域
  • rank of a linear transformation T: 線性轉換T的秩
  • nullity of a linear transformation T: 線性轉換T的核次數
  • one-to-one: 一對一
  • onto: 映成
  • isomorphism(one-to-one and onto): 同構
  • isomorphic space: 同構的空間

47/103

49 of 103

6.3 Matrices for Linear Transformations

  • Three reasons for matrix representation of a linear transformation:
    • It is simpler to write.
    • It is simpler to read.
    • It is more easily adapted for computer use.
  • Two representations of the linear transformation T:R3R3 :

Elementary Linear Algebra: Section 6.3, p.320

48/103

50 of 103

  • Thm 6.10: (Standard matrix for a linear transformation)

Elementary Linear Algebra: Section 6.3, p.320

49/103

51 of 103

Pf:

Elementary Linear Algebra: Section 6.3, p.321

50/103

52 of 103

Elementary Linear Algebra: Section 6.3, p.321

51/103

53 of 103

  • Ex 1: (Finding the standard matrix of a linear transformation)

Sol:

Vector Notation Matrix Notation

Elementary Linear Algebra: Section 6.3, p.321

52/103

54 of 103

  • Note:
  • Check:

Elementary Linear Algebra: Section 6.3, p.321

53/103

55 of 103

  • Ex 2: (Finding the standard matrix of a linear transformation)

Sol:

  • Notes:

(1) The standard matrix for the zero transformation from Rn into Rm

is the m × n zero matrix.

(2) The standard matrix for the zero transformation from Rn into Rn

is the n × n identity matrix In.

Elementary Linear Algebra: Section 6.3, p.322

54/103

56 of 103

  • Composition of T1:RnRm with T2:RmRp :
  • Thm 6.11: (Composition of linear transformations)

Elementary Linear Algebra: Section 6.3, p.323

55/103

57 of 103

Pf:

  • Note:

Elementary Linear Algebra: Section 6.3, p.323

56/103

58 of 103

  • Ex 3: (The standard matrix of a composition)

Sol:

Elementary Linear Algebra: Section 6.3, p.324

57/103

59 of 103

Elementary Linear Algebra: Section 6.3, p.324

58/103

60 of 103

  • Inverse linear transformation:
  • Note:

If the transformation T is invertible, then the inverse is unique and denoted by T–1 .

Elementary Linear Algebra: Section 6.3, p.324

59/103

61 of 103

  • Thm 6.12: (Existence of an inverse transformation)
  • Note:

If T is invertible with standard matrix A, then the standard matrix for T–1 is A–1 .

  1. T is invertible.
  2. T is an isomorphism.
  3. A is invertible.

Elementary Linear Algebra: Section 6.3, p.325

60/103

62 of 103

  • Ex 4: (Finding the inverse of a linear transformation)

Sol:

Show that T is invertible, and find its inverse.

Elementary Linear Algebra: Section 6.3, p.325

61/103

63 of 103

Elementary Linear Algebra: Section 6.3, p.325

62/103

64 of 103

  • the matrix of T relative to the bases B and B':

Thus, the matrix of T relative to the bases B and B' is

Elementary Linear Algebra: Section 6.3, p.326

63/103

65 of 103

  • Transformation matrix for nonstandard bases:

Elementary Linear Algebra: Section 6.3, p.326

64/103

66 of 103

Elementary Linear Algebra: Section 6.3, p.326

65/103

67 of 103

  • Ex 5: (Finding a matrix relative to nonstandard bases)

Sol:

Elementary Linear Algebra: Section 6.3, p.326

66/103

68 of 103

  • Ex 6:

Sol:

  • Check:

Elementary Linear Algebra: Section 6.3, p.327

67/103

69 of 103

  • Notes:

Elementary Linear Algebra, Section 6.3, p.327

68/103

70 of 103

Key Learning in Section 6.3

  • Find the standard matrix for a linear transformation.
  • Find the standard matrix for the composition of linear transformations and find the inverse of an invertible linear transformation.
  • Find the matrix for a linear transformation relative to a nonstandard basis.

69/103

71 of 103

Keywords in Section 6.3

  • standard matrix for T: T 的標準矩陣
  • composition of linear transformations: 線性轉換的合成
  • inverse linear transformation: 反線性轉換
  • matrix of T relative to the bases B and B' : T對應於基底BB'的矩陣
  • matrix of T relative to the basis B: T對應於基底B的矩陣

70/103

72 of 103

6.4 Transition Matrices and Similarity

Elementary Linear Algebra: Section 6.4, p.330

71/103

73 of 103

  • Two ways to get from to :

Elementary Linear Algebra: Section 6.4, p.330

72/103

74 of 103

  • Ex 1: (Finding a matrix for a linear transformation)

Sol:

Elementary Linear Algebra: Section 6.4, p.330

73/103

75 of 103

Elementary Linear Algebra: Section 6.4, p.330

74/103

76 of 103

  • Ex 2: (Finding a matrix for a linear transformation)

Sol:

Elementary Linear Algebra: Section 6.4, p.331

75/103

77 of 103

  • Ex 3: (Finding a matrix for a linear transformation)

Sol:

Elementary Linear Algebra: Section 6.4, p.331

76/103

78 of 103

  • Similar matrix:

For square matrices A and A‘ of order n, A‘ is said to be similar to A if there exist an invertible matrix P s.t.

  • Thm 6.13: (Properties of similar matrices)

Let A, B, and C be square matrices of order n.

Then the following properties are true.

(1) A is similar to A.

(2) If A is similar to B, then B is similar to A.

(3) If A is similar to B and B is similar to C, then A is similar to C.

Pf:

Elementary Linear Algebra: Section 6.4, p.332

77/103

79 of 103

  • Ex 4: (Similar matrices)

Elementary Linear Algebra: Section 6.4, p.332

78/103

80 of 103

  • Ex 5: (A comparison of two matrices for a linear transformation)

Sol:

Elementary Linear Algebra: Section 6.4, p.333

79/103

81 of 103

Elementary Linear Algebra: Section 6.4, p.333

80/103

82 of 103

  • Notes: Computational advantages of diagonal matrices:

Elementary Linear Algebra: Section 6.4, p.333

81/103

83 of 103

Key Learning in Section 6.4

  • Find and use a matrix for a linear transformation.
  • Show that two matrices are similar and use the properties of similar matrices.

82/103

84 of 103

Keywords in Section 6.4

  • matrix of T relative to B: T 相對於B的矩陣
  • matrix of T relative to B' : T 相對於B'的矩陣
  • transition matrix from B' to B : 從B'B的轉移矩陣
  • transition matrix from B to B' : 從BB'的轉移矩陣
  • similar matrix: 相似矩陣

83/103

85 of 103

6.5 Applications of Linear Transformations

  • Elementary matrices for linear transformations in R2:

Reflection in y-axis

Reflection in x-axis

Reflection in line y = x

Horizontal expansion (k > 1)

or contraction (0 < k < 1)

Vertical expansion (k > 1)

or contraction (0 < k < 1)

Horizontal shear

Vertical shear

Elementary Linear Algebra: Section 6.5, p.336

84/103

86 of 103

  • Ex 1: (Reflections in R2)

a. Reflection

in the y-axis

b. Reflection

in the x-axis

c. Reflection

in the line y = x

Elementary Linear Algebra: Section 6.5, p.336

85/103

87 of 103

  • Ex 2: (Expansions and Contractions in R2)

a. Horizontal contractions

and expansions

b. Vertical contractions

and expansions

Elementary Linear Algebra: Section 6.5, p.337

86/103

88 of 103

  • Ex 3: (Shears in R2)

a. Horizontal shear

Under this transformation, points in the upper half-plane “shear” to the right by amounts proportional to their y-coordinates. Points in the lower half-plane “shear” to the left by amounts proportional to the absolute values of their y-coordinates. Points on the x-axis do not move by this transformation.

Elementary Linear Algebra: Section 6.5, p.338

87/103

89 of 103

b. Vertical shear

Here, points in the right half-plane “shear” upward by amounts proportional to their x-coordinates. Points in the left half-plane “shear” downward by amounts proportional to the absolute values of their x-coordinates. Points on the y-axis do not move.

Elementary Linear Algebra: Section 6.5, p.338

88/103

90 of 103

  • Rotation in R3:

Suppose you want to rotate the point (x, y, z) counterclockwise about the z-axis through an angle θ.

Elementary Linear Algebra: Section 6.5, p.338

89/103

91 of 103

  • Ex 4: (Rotation About the z-axis)

Sol:

a. A rotation of

Elementary Linear Algebra: Section 6.5, p.339

90/103

92 of 103

b. A rotation of

c. A rotation of

Elementary Linear Algebra: Section 6.5, p.339

91/103

93 of 103

Rotation about the z-axis

Rotation about the y-axis

Rotation about the x-axis

Elementary Linear Algebra: Section 6.5, p.340

92/103

94 of 103

  • Note:

To illustrate the right-hand rule, imagine the thumb of your right hand pointing in the positive direction of an axis. The cupped fingers will point in the direction of counterclockwise rotation. The figure below shows counterclockwise rotation about the z-axis.

Elementary Linear Algebra: Section 6.5, p.340

93/103

95 of 103

  • Ex 5: (Rotation About the x-Axis and y-Axis)

(a) A rotation of about the x-axis

(b) A rotation of about the y-axis

Elementary Linear Algebra: Section 6.5, p.340

94/103

96 of 103

Key Learning in Section 6.5

  • Identify linear transformations defined by reflections, expansions, contractions, or shears in R2.
  • Use a linear transformation to rotate a figure in R3.

95/103

97 of 103

Keywords in Section 6.5

  • reflection: 鏡射
  • expansion: 擴展
  • contraction: 縮減
  • share: 切變
  • rectangular prism: 長方體

96/103

98 of 103

  • Multivariate Statistics

Many multivariate statistical methods can use linear transformations. For instance, in a multiple regression analysis, there are two or more independent variables and a single dependent variable. A linear transformation is useful for finding weights to be assigned to the independent variables to predict the value of the dependent variable. Also, in a canonical correlation analysis, there are two or more independent variables and two or more dependent variables. Linear transformations can help find a linear combination of the independent variables to predict the value of a linear combination of the dependent variables.

6.1 Linear Algebra Applied

Elementary Linear Algebra: Section 6.1, p.304

97/103

99 of 103

  • Control Systems

A control system, such as the one shown for a dairy factory, processes an input signal xk and produces an output signal xk+1. Without external feedback, the difference equation xk+1 = Axk, a linear transformation where xi is an n × 1 vector and A is an n × n matrix, can model the relationship between the input and output signals. Typically, however, a control system has external feedback, so the relationship becomes xk+1 = Axk+Buk, where B is an n 🞨m matrix and uk is an m × 1 input, or control, vector. A system is called controllable when it can reach any desired final state from its initial state in or fewer steps. If A and B make up a controllable system, then the rank of the controllability matrix

[B AB A2B . . . An-1B]

is equal to n.

6.2 Linear Algebra Applied

Elementary Linear Algebra: Section 6.2, 314

98/103

100 of 103

  • Circuit Design

Ladder networks are useful tools for electrical engineers involved in circuit design. In a ladder network, the output voltage V and current I of one circuit are the input voltage and current of the circuit next to it. In the ladder network shown below, linear transformations can relate the input and output of an individual circuit (enclosed in a dashed box). Using Kirchhoff’s Voltage and Current Laws and Ohm’s Law,

and

6.3 Linear Algebra Applied

Elementary Linear Algebra: Section 6.3, p.322

99/103

101 of 103

  • Circuit Design

A composition can relate the input and output of the entire ladder network, that is, V1 and I1 to V3 and I3. Discussion on the composition of linear transformations begins on the following page.

6.3 Linear Algebra Applied

Elementary Linear Algebra: Section 6.3, p.322

100/103

102 of 103

  • Weather

A Leslie matrix, named after British mathematician Patrick H. Leslie (1900–1974), can be used to find the age and growth distributions of a population over time. The entries in the first row of an n × n Leslie matrix L are the average numbers of offspring per member for each of n age classes. The entries in subsequent rows are pi in row i +1, column i and 0 elsewhere, where pi is the probability that an ith age class member will survive to become an (i +1)th age class member. If xj is the age distribution vector for the jth time period, then the age distribution vector for the (j +1)th time period can be found using the linear transformation xj+1 = Lxj. You will study population growth models using Leslie matrices in more detail in Section 7.4.

6.4 Linear Algebra Applied

Elementary Linear Algebra: Section 6.4, p.331

101/103

103 of 103

  • Computer Graphics

The use of computer graphics is common in many fields. By using graphics software, a designer can “see” an object before it is physically created. Linear transformations can be useful in computer graphics. To illustrate with a simplified example, only 23 points in R3 were used to generate images of the toy boat shown in the figure at the left. Most graphics software can use such minimal information to generate views of an image from any perspective, as well as color, shade, and render as appropriate. Linear transformations, specifically those that produce rotations in R3 can represent the different views. The remainder of this section discusses rotation in R3.

6.5 Linear Algebra Applied

Elementary Linear Algebra: Section 6.5, p.338

102/103