1 of 32

1

Grid Cells: Global positioning system that helps people navigate

2 of 32

2

Inside the Nucleus: Chromosome Territories

Tan, Longzhi, et al. "Three-dimensional genome structures of single diploid human cells." Science 361.6405 (2018): 924-928.

3 of 32

3

A Tensor is an 𝑑-way array

 

 

 

 

4 of 32

If you need more information, these references are helpful:�

  1. Kolda, T. G., & Bader, B. W. (2009). Tensor decompositions and applications. SIAM review, 51(3), 455-500.
  2. Matlab Tensor Toolbox: https://www.tensortoolbox.org/

The following slides contain material from Tammy Kolda, Charles Van Loan and Lars Elden

Tensor Decompositions

 

5 of 32

 

What is a Tensor

 

6 of 32

6

Tensor

Definition:

7 of 32

7

Notations

8 of 32

8

Tensor Unfolding

9 of 32

9

A Common Framework for Tensor Computations

Tensor Unfolding

10 of 32

10

Illustration of row-wise and column-wise unfolding (flattening, matricizing) of a third-order tensor

Andrzej Cichocki, Rafal Zdunek, and Shun'ichi Amari. Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-way Data Analysis and Blind Source (2009)

11 of 32

11

Unfolding (matricizing) of a third-order tensor

12 of 32

12

SVD Expansion

13 of 32

Tensor Decompositions

CP Model: Sum of d-way outer products, useful for interpretation

Tucker Model: Project onto high-variance subspaces to reduce dimensionality

14 of 32

14

The Kronecker Product

15 of 32

15

The Kronecker Product

16 of 32

16

All Possible Entry- Entry Products

17 of 32

17

Kronecker Products of Kronecker Products

18 of 32

18

You have seen them before

19 of 32

19

Block matrix

20 of 32

20

Block Matrices: Addition

21 of 32

21

Block Matrix: Multiplication

22 of 32

22

Block Matrix: Transposition

23 of 32

23

A block matrix can have block matrix entries

24 of 32

24

Reshape

25 of 32

25

Reshape

26 of 32

26

SVD

27 of 32

27

SVD

28 of 32

28

The Tucker product

Definition:

29 of 32

29

The Tucker product representation

Before…

Now…

30 of 32

30

The Higher-Order SVD (HOSVD)

31 of 32

31

The HOSVD of a matrix

32 of 32

32

The HOSVD of a matrix