CMSE 890.001: Tensor Networks 1
Lecture: T/Th 12:40-2pm, 1225 EGR
Office hours: Th 4-5:30pm, 2507E EB or by appointment if needed (email me)
Instructor: Ryan LaRose, rmlarose@msu.edu
Tensor networks are a powerful theoretical and computational tool for problems ranging from machine learning to condensed matter and quantum physics. This course provides a practical introduction to tensor networks to enable you to use them in your research and/or contribute to open problems in the field. After reviewing linear algebra, we’ll introduce the fundamentals of tensor networks including notation, contraction, and complexity, then cover specific tensor networks such as matrix product states which have wide-ranging applications. Lectures will focus on practical, hands-on aspects while still emphasizing the underlying theory, and homework assignments will include mathematical and programming exercises. A final project on the application or theory of tensor networks constitutes a bulk of the course.
For a refresher on these prerequisites, I recommend the relevant topics from Harvard AM205 which run parallel to Trefethen and Bau, Numerical Linear Algebra.
The course will be thematically divided into three “phases” with the following main topics:
Phase 1: Tensor network fundamentals
Scientific computing, computational complexity, matrix factorizations & algorithms, tensors, tensor networks
Phase 2: The tensor network canon
Matrix product states, matrix product operators, DMRG, TEBD
Phase 3: Additional tensor networks and applications
Applications of tensor networks in physics, machine learning, etc., & additional tensor networks such as PEPS, tree tensor networks, MERA, etc.
The two main sources we will use are:
In the schedule, these are respectively referred to as “Chubb” and “Mari”. Additional online sources on a topic-by-topic basis may be linked in the schedule.
Homework | 40% |
Project | 50% |
Attendance & participation | 10% |
There will be four homework assignments of equal weight (4 x 10%). Announcements and due dates will be posted on the schedule.
Project evaluation is broken down into the following categories:
Attendance and participation is based on an honest effort to come to lectures and participate in class. In addition to staying up with lectures, attendance is important because some classes will be flipped and/or include individual/group work. Four absences will be excused without question. For longer absences please contact me.
Grading scale: 4.0 ≥ 90%, 3.5 ≥ 80%, 3.0 ≥ 75%, 2.5 ≥ 70%, 2.0 ≥ 65%, 1.5 ≥ 60%, 1.0 ≥ 50%, 0.0 < 50%
You are expected to adhere to the Spartan Code of Honor academic pledge, as written by the Associated Students of Michigan State University (ASMSU):
“As a Spartan, I will strive to uphold values of the highest ethical standard. I will practice honesty in my work, foster honesty in my peers, and take pride in knowing that honor is worth more than grades. I will carry these values beyond my time as a student at Michigan State University, continuing the endeavor to build personal integrity in all that I do.”
Violations of academic integrity are inexcusable and will not be tolerated.
If you have a university-documented learning difficulty or require other accommodations, please provide your instructor with your VISA as soon as possible and speak with them about how they can assist you in your learning. If you do not have a VISA but have been documented with a learning difficulty or other problems for which you may still require accommodation, please contact MSU’s Resource Center for People with Disabilities (355-9642) in order to acquire current documentation.
Note: This schedule is a living document and will be updated throughout the semester.
Lecture | Topics | Reading | Lecture notes | Assignments / Announcements |
T Aug 27 | Course overview | None | ||
Th Aug 29 | Scientific computing & computational complexity | Harvard AM205 Videos 0.2 - 0.4 | ||
T Sep 3 | Matrix factorizations and algorithms | Harvard AM205 Videos 2.7 - 2.8, 5.1 - 5.2, 5.4 - 5.6 | ||
Th Sep 5 | Tensors and tensor operations | Mari pages 6 - 13 Chubb Sec. 1.1 & 1.2 | HW1 available, due Friday Sep 20 by 11:59pm. | |
T Sep 10 | Guest lecture: ICER and the Data Machine by Craig Gross | None | ||
Th Sep 12 | No class | |||
T Sep 17 | Tensor networks and contraction I | Chubb Sec. 1.3 - 1.5 | Correction to HW1 problem on tensor norms — re-open the Colab if you already made a copy to see. | |
Th Sep 19 | Tensor networks and contraction II | Sec. VI of Tensor Networks in a Nutshell Sec. I-IV of Simulating quantum computation by contracting tensor networks | HW1 due Friday Sep 20 by 11:59pm. | |
T Sep 24 | Matrix Product States I | Chubb Sec 3 Mari Sec II.B Sec. 4 of https://arxiv.org/abs/1008.3477 https://tensornetwork.org/mps/ | HW1 graded. Sample solutions. | |
Th Sep 26 | Krylov, Arnoldi, and Lanczos | (Parallel to Lecture 36 of Trefethen and Bau) | HW2 available, due Fri Oct 11 by 11:59pm. | |
T Oct 1 | Matrix Product States II | Chubb Sec 3 Mari Sec II.B Sec. 4 of https://arxiv.org/abs/1008.3477 | ||
Th Oct 3 | Matrix Product States III | Chubb Sec 3 Mari Sec II.B Sec. 4 of https://arxiv.org/abs/1008.3477 | ||
T Oct 8 | Matrix Product Operators | Mari Sec III.A Sec. 5 of https://arxiv.org/abs/1008.3477 | ||
Th Oct 10 | DMRG I | Chub Sec. 5.1 | HW2 due Fri Oct 11 by 11:59pm. | |
T Oct 15 | DMRG II | Chub Sec. 5.1 | ||
Th Oct 17 | Project proposals | None | Project proposals due in class. Please fill out Mid semester feedback! forms.gle/4CCoaEo5siWsFi9E9 | |
T Oct 22 | Fall break | |||
Th Oct 24 | Quantum compilation inspired by DMRG | [2306.08152] QFactor: A Domain-Specific Optimizer for Quantum Circuit Instantiation | HW3 available, due Wed Nov 6 by 11:59pm | |
T Oct 29 | TEBD I | Chubb Sec. 5.2 [quant-ph/0301063] Efficient classical simulation of slightly entangled quantum computations Sec. 7 of https://arxiv.org/abs/1008.3477 | ||
Th Oct 31 | TEBD II | Chubb Sec. 5.2 [quant-ph/0301063] Efficient classical simulation of slightly entangled quantum computations Sec. 7 of https://arxiv.org/abs/1008.3477 | ||
T Nov 5 | Machine learning with tensor networks | ML background: Lectures 1-2, 6-7 of https://matthewhirn.com/teaching/spring-2017-cmse-820/ [1605.05775] Supervised Learning with Quantum-Inspired Tensor Networks | HW2 graded HW3 due Wed Nov 6 by 11:59pm | |
Th Nov 7 | From MPS to PEPS | Mari Sec. IIC Original PEPS paper: https://arxiv.org/abs/cond-mat/0407066 Slides on PEPS: https://pitp.phas.ubc.ca/confs/sherbrooke2012/archives/PEPS.pdf | HW4 available, due Fri Nov 22 by 11:59pm | |
T Nov 12 | TTNs and MERA | Mari Sec. IID Original TTNs paper: https://arxiv.org/abs/quant-ph/0511070 DMRG with TTNs: https://arxiv.org/abs/1302.2298 and the references therein Original MERA paper: https://journals.aps.org/prl/abstract/10.1103/PhysRevLett.99.220405 MERA/Entanglement normalization intro: https://arxiv.org/abs/0912.1651 | HW3 graded Project checkpoints due by Wed Nov 13 by 11:59pm | |
Th Nov 14 | In-class project work day | None | Project rubric available. Note: 10 + 2 minute presentations | |
T Nov 19 | The infinite algorithms | iDMRG: Sec. 2 and Sec. 10 of https://arxiv.org/abs/1008.3477 See especially muellergroup.lassp.cornell.edu/bt2020chap5.pdf | HW4 due Fri Nov 22 by 11:59pm | |
Th Nov 21 | Tensors on Tensor Processing Units | https://arxiv.org/abs/2112.09017 | ||
T Nov 26 | The story of quantum supremacy and tensor networks | |||
Th Nov 28 | Thanksgiving break | |||
T Dec 3 | Project presentations I | |||
Th Dec 5 | Project presentations II | Final project reports due Friday Dec 6 by 11:59 pm |