Published using Google Docs
cmse890.001-tensor-networks-f24
Updated automatically every 5 minutes

CMSE 890.001: Tensor Networks

Table of contents

CMSE 890.001: Tensor Networks        1

Table of contents        1

Overview        1

Prerequisites        1

Topic list        2

Reading        2

Grading        2

Academic Integrity        3

Accommodations        3

Schedule        4

Overview

Lecture: T/Th 12:40-2pm, 1225 EGR

Office hours: Th 4-5:30pm, 2507E EB or by appointment if needed (email me)

Instructor: Ryan LaRose, rmlarose@msu.edu 

Tensor networks are a powerful theoretical and computational tool for problems ranging from machine learning to condensed matter and quantum physics. This course provides a practical introduction to tensor networks to enable you to use them in your research and/or contribute to open problems in the field. After reviewing linear algebra, we’ll introduce the fundamentals of tensor networks including notation, contraction, and complexity, then cover specific tensor networks such as matrix product states which have wide-ranging applications. Lectures will focus on practical, hands-on aspects while still emphasizing the underlying theory, and homework assignments will include mathematical and programming exercises. A final project on the application or theory of tensor networks constitutes a bulk of the course.

Prerequisites

For a refresher on these prerequisites, I recommend the relevant topics from Harvard AM205 which run parallel to Trefethen and Bau, Numerical Linear Algebra.

Topics

The course will be thematically divided into three “phases” with the following main topics:

Phase 1: Tensor network fundamentals

Scientific computing, computational complexity, matrix factorizations & algorithms, tensors,  tensor networks

Phase 2: The tensor network canon

Matrix product states, matrix product operators, DMRG, TEBD

Phase 3: Additional tensor networks and applications

Applications of tensor networks in physics, machine learning, etc., & additional tensor networks such as PEPS, tree tensor networks, MERA, etc.

Reading

The two main sources we will use are:

In the schedule, these are respectively referred to as “Chubb” and “Mari”. Additional online sources on a topic-by-topic basis may be linked in the schedule.

Grading

Homework

40%

Project

50%

Attendance & participation

10%

There will be four homework assignments of equal weight (4 x 10%). Announcements and due dates will be posted on the schedule.

Project evaluation is broken down into the following categories:

Attendance and participation is based on an honest effort to come to lectures and participate in class. In addition to staying up with lectures, attendance is important because some classes will be flipped and/or include individual/group work. Four absences will be excused without question. For longer absences please contact me.

Grading scale: 4.0 ≥ 90%, 3.5 ≥ 80%, 3.0 ≥ 75%, 2.5 ≥ 70%, 2.0 ≥ 65%, 1.5 ≥ 60%, 1.0 ≥ 50%, 0.0 < 50%

Academic Integrity

You are expected to adhere to the Spartan Code of Honor academic pledge, as written by the Associated Students of Michigan State University (ASMSU):

“As a Spartan, I will strive to uphold values of the highest ethical standard. I will practice honesty in my work, foster honesty in my peers, and take pride in knowing that honor is worth more than grades. I will carry these values beyond my time as a student at Michigan State University, continuing the endeavor to build personal integrity in all that I do.”

Violations of academic integrity are inexcusable and will not be tolerated.

Accommodations

If you have a university-documented learning difficulty or require other accommodations, please provide your instructor with your VISA as soon as possible and speak with them about how they can assist you in your learning. If you do not have a VISA but have been documented with a learning difficulty or other problems for which you may still require accommodation, please contact MSU’s Resource Center for People with Disabilities (355-9642) in order to acquire current documentation.


Schedule

Note: This schedule is a living document and will be updated throughout the semester.

Lecture

Topics

Reading

Lecture notes

Assignments / Announcements

T Aug 27

Course overview

None

GDrive 01

Colab: Python basics and tensor networks intro

Th Aug 29

Scientific computing & computational complexity

Harvard AM205 Videos 0.2 - 0.4

GDrive 02

T Sep 3

Matrix factorizations and algorithms

Harvard AM205 Videos 2.7 - 2.8, 5.1 - 5.2, 5.4 - 5.6

GDrive 03

Th Sep 5

Tensors and tensor operations

Mari pages 6 - 13

Chubb Sec. 1.1 & 1.2

GDrive 04

HW1 available, due Friday Sep 20 by 11:59pm.

T Sep 10

Guest lecture: ICER and the Data Machine by Craig Gross

None

ICER documentation

Th Sep 12

No class

T Sep 17

Tensor networks and contraction I

Chubb Sec. 1.3 - 1.5

GDrive 05

Colab: Tensor network contraction

Correction to HW1 problem on tensor norms — re-open the Colab if you already made a copy to see.

Th Sep 19

Tensor networks and contraction II

Sec. VI of Tensor Networks in a Nutshell

Sec. I-IV of Simulating quantum computation by contracting tensor networks 

GDrive 06

HW1 due Friday Sep 20 by 11:59pm.

T Sep 24

Matrix Product States I

Chubb Sec 3

Mari Sec II.B

Sec. 4 of https://arxiv.org/abs/1008.3477 

https://tensornetwork.org/mps/ 

GDrive 07

Colab: Decompose an arbitrary vector into an MPS

HW1 graded. Sample solutions.

Th Sep 26

Krylov, Arnoldi, and Lanczos

Harvard AM205 Video 5.9

(Parallel to Lecture 36 of Trefethen and Bau)

GDrive 08

Colab: Lanczos with tensor networks

HW2 available, due Fri Oct 11 by 11:59pm.

T Oct 1

Matrix Product States II

Chubb Sec 3

Mari Sec II.B

Sec. 4 of https://arxiv.org/abs/1008.3477 

https://tensornetwork.org/mps/ 

GDrive 09

Th Oct 3

Matrix Product States III

Chubb Sec 3

Mari Sec II.B

Sec. 4 of https://arxiv.org/abs/1008.3477 

https://tensornetwork.org/mps/ 

GDrive 10

T Oct 8

Matrix Product Operators

Mari Sec III.A

Sec. 5 of https://arxiv.org/abs/1008.3477 

GDrive 11

Th Oct 10

DMRG I

Chub Sec. 5.1

GDrive 12

Colab: Implement DMRG-1

HW2 due Fri Oct 11 by 11:59pm.

T Oct 15

DMRG II

Chub Sec. 5.1

Colab: Implement DMRG-1

Th Oct 17

Project proposals

None

Project proposals due in class.

Please fill out Mid semester feedback! forms.gle/4CCoaEo5siWsFi9E9 

T Oct 22

Fall break

Th Oct 24

Quantum compilation inspired by DMRG

[2306.08152] QFactor: A Domain-Specific Optimizer for Quantum Circuit Instantiation 

GDrive 13

HW3 available, due Wed Nov 6 by 11:59pm

T Oct 29

TEBD I

Chubb Sec. 5.2

[quant-ph/0301063] Efficient classical simulation of slightly entangled quantum computations

Sec. 7 of https://arxiv.org/abs/1008.3477 

GDrive 14

Th Oct 31

TEBD II

Chubb Sec. 5.2

[quant-ph/0301063] Efficient classical simulation of slightly entangled quantum computations 

Sec. 7 of https://arxiv.org/abs/1008.3477 

GDrive 15

Colab: Implement TEBD

T Nov 5

Machine learning with tensor networks

ML background: Lectures 1-2, 6-7 of https://matthewhirn.com/teaching/spring-2017-cmse-820/ 

[1605.05775] Supervised Learning with Quantum-Inspired Tensor Networks   

GDrive 16

HW2 graded

HW3 due Wed Nov 6 by 11:59pm

Th Nov 7

From MPS to PEPS

Mari Sec. IIC

Original PEPS paper: https://arxiv.org/abs/cond-mat/0407066

Slides on PEPS: https://pitp.phas.ubc.ca/confs/sherbrooke2012/archives/PEPS.pdf 

GDrive 17

HW4 available, due Fri Nov 22 by 11:59pm

T Nov 12

TTNs and MERA

Mari Sec. IID

Original TTNs paper: https://arxiv.org/abs/quant-ph/0511070

DMRG with TTNs: https://arxiv.org/abs/1302.2298 and the references therein

Original MERA paper: https://journals.aps.org/prl/abstract/10.1103/PhysRevLett.99.220405

MERA/Entanglement normalization intro: https://arxiv.org/abs/0912.1651

GDrive 18

HW3 graded

Project checkpoints due by Wed Nov 13 by 11:59pm

Th Nov 14

In-class project work day

None

Project rubric

Project rubric available.

Note: 10 + 2 minute presentations

T Nov 19

The infinite algorithms

iDMRG: Sec. 2 and Sec. 10 of https://arxiv.org/abs/1008.3477 

See especially muellergroup.lassp.cornell.edu/bt2020chap5.pdf 

iTEBD: https://arxiv.org/abs/cond-mat/0605597 

GDrive 19

HW4 due Fri Nov 22 by 11:59pm

Th Nov 21

Tensors on Tensor Processing Units

https://arxiv.org/abs/2112.09017 

https://arxiv.org/abs/2204.05693 

https://cloud.google.com/tpu/docs/intro-to-tpu 

Colab: Tensors on TPUs

T Nov 26

The story of quantum supremacy and tensor networks

GDrive 20

Th Nov 28

Thanksgiving break

T Dec 3

Project presentations I

Project presentations (MSU only)

Th Dec 5

Project presentations II

Final project reports due Friday Dec 6 by 11:59 pm