1 of 22

Empowering deep neural quantum states through efficient optimization

arXiv:2302.01941

Ao Chen and Markus Heyl

University of Augsburg

2 of 22

Why neural �quantum states?

3 of 22

Image recognition

Input image

 

Model

0.98

0.12

4 of 22

Game of go

Game status

 

Model

0.12

5 of 22

Quantum many-body

 

 

Model

0.41

-0.25

 

6 of 22

First step

G. Carleo, & M. Troyer, Science (2017)

 

7 of 22

Past five years

8 of 22

Frustrated J1-J2 model

 

K. Choo, T. Neupert & G. Carleo, Phys. Rev. B (2019)

Method

Energy

CNN

DMRG

Traditional VMC

Ground state

 

Convolutional neural network (CNN)

9 of 22

NQS can’t learn signs?

24-site Kagome J1-J2

T. Westerhout, et al., Nat. Commun. (2020)

 

Method

Energy

CNN

Simple sign rule limit

Traditional VMC

Ground state

10 of 22

DON’T separate amplitudes and signs

Z. Cai & J. Liu, Phys. Rev. B (2018)

A. Szabó & C. Castelnovo, Phys. Rev. Res. (2020)

M. Bukov, M. Schmitt & M. Dupont, SciPost Phys. (2021)

A. Chen, et al., Phys. Rev. Res. (2022)

G. Torlai, et al., Nat. Phys. (2018)

11 of 22

Network design

Autoregressive network

O. Sharir, et al., Phys. Rev. Lett. (2020)

Recurrent neural network (RNN)

M. Hibat-Allah, et al., Phys. Rev. Res. (2020)

Symmetry projection

Y. Normura, J. Phys.: Condens. Matter (2021)

M. Reh, M. Schmitt & M. Gärttner, Phys. Rev. B (2023)

Group convolutional neural network (GCNN)

C. Roth, A. Szabó & A. H. MacDonald, Phys. Rev. B (2023)

Vision transformer (ViT)

L. L. Viteritti, R. Rende & F. Becca, Phys. Rev. Lett. (2023)

12 of 22

More �(parameters) �is different

13 of 22

Deeper NQS

 

Method

Energy

CNN

Simple sign rule limit

Traditional VMC

Ground state

M. Li, et al., IEEE TPDS (2022)

Deep Boltzmann machine

X. Gao & L. Duan, Nat. Commun. (2017)

G. Carleo, Y. Nomura, M. Imada, Nat. Commun. (2018)

14 of 22

Optimization

 

Stochastic gradient descent (SGD)

 

Stochastic reconfiguration (SR)

 

 

 

 

 

 

15 of 22

MinSR

 

 

 

 

 

 

 

 

 

 

 

16 of 22

Benchmark model

 

 

Method

Energy

CNN

Traditional VMC

Deep CNN

(MinSR)

Ground state

17 of 22

Application: �quantum spin liquids

18 of 22

Energy gap of quantum spin liquids

Y. Nomura & M. Imada, Phys. Rev. X (2021)

Y. Iqbal, et al., Phys. Rev. B (2016)

 

 

19 of 22

Structure factor

20 of 22

Summary

Sign structure

Network design

MinSR

 

21 of 22

Fermionic lattice

Y. Nomura, et al., Phys. Rev. B (2017)

D. Luo & B. K. Clark, Phys. Rev. Lett. (2019)

J. R. Moreno, et al., PNAS (2022)

Quantum spin liquid

Y. Nomura & M. Imada, Phys. Rev. X (2021)

Quantum chemistry

J. Hermann, et al., Nat. Rev. Chem. (2023)

Quantum dynamics

M. Schmitt & M. Heyl, Phys. Rev. Lett. (2020)

A. Sinibaldi, et al., Quantum (2023)

J. Hermann, et al., Nat. Chem. (2020)

D. Pfau, et al., Phys. Rev. Res. (2020)

Encoding physical backgrounds

Y. Nomura, et al., Phys. Rev. B (2017)

Z. Chen, et al., NIPS (2023)

More...

22 of 22

Thank you!