ABCDEFGHIJKLMNOPQRSTUVWXY
1
DATETIMETOPICGOOGLE_SLIDESRECORDINGREADINGSREADING_LINKSNOTESMISC
2
8/22/202313:25:00Introductionhttps://docs.google.com/presentation/d/1j4QzlAScoY5DkyhDrcVbZjekoh0Xb3AR2I1WQd7v9tU/edit?usp=drive_linkhttps://vod.video.cornell.edu/media/Lecture+01+-+introduction,+CS4740+23FA/1_84gj5jqq/312787162
3
8/24/202313:25:00Language Modeling/N-gramshttps://docs.google.com/presentation/d/1nYt-169yg8I759scQ-8IMOyiat66hNDfre4iQi03WZ0/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+02+LMs-and-ngrams%2C+CS4740+23FA/1_jyf58wjmJurafsky and Martin (henceforth JM) chapter 3 through section 3.1, 3.4 (focus on the part starting with the sentence "Matching genres and dialects is still not sufficient"), 3.5-3.5.1;https://web.stanford.edu/~jurafsky/slp3/3.pdf;
4
8/29/202313:25:00Sequence Tagging / HMMs / Viterbihttps://docs.google.com/presentation/d/1XasA4h9161xMcOqIhlgd3KxxnOKMp7vUfr9cgSqGjkI/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+03-+hmms_and_viterbi%2C+CS4740+23FA/1_6szkexegJM chapter 8 through section 8.5.1;
JM Appendix A through section A.2, section A.4;		https://web.stanford.edu/~jurafsky/slp3/9.pdf;
https://web.stanford.edu/~jurafsky/slp3/A.pdf;
5
8/31/202313:25:00MEMMs, Viterbi, and Named Entity Recognitionhttps://docs.google.com/presentation/d/1wtRO5CeqLAa3jKDPbCT6su2dYthwEIdYvwnnY4rBwR8/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+04-hmms_and_memms+CS4740+23FA/1_rgsyggpuJM chapter section 4.2 (think of a class as an HMM state);
JM section 5.2-5.3;
JM 8.5-8.6;		https://web.stanford.edu/~jurafsky/slp3/4.pdf;
https://web.stanford.edu/~jurafsky/slp3/5.pdf;
https://web.stanford.edu/~jurafsky/slp3/8.pdf;
6
9/5/202313:25:00NER and Semantic Role Labeling https://docs.google.com/presentation/d/1HZBaA5rb0RSJSyXZryJZOQob3jhe1Fa9Ik7AwpREXDM/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+05+-+ner_srl+CS4740+23FA/1_daavoljeJM 4.7; https://web.stanford.edu/~jurafsky/slp3/4.pdf;
7
9/7/202313:25:00Word Embeddings / Vector Semanticshttps://docs.google.com/presentation/d/1gXRiIq_FMEapJBpk6Yh9YKc_ppDxAWy6j1_XsQWiGDs/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+06-+word_vectors+CS4740+23FA/1_e1hs32ptJM chapter 6 sections 6.2-6.5, 6.8 through 6.8.2;https://web.stanford.edu/~jurafsky/slp3/6.pdf;
8
9/12/202313:25:00FFNNshttps://docs.google.com/presentation/d/1QebJpAeGvVyrsQPDzpp2ydKb57IA05mkSGUVKQ1uoHo/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+07-feed-forward-neural-networks+CS4740+23FA/1_z8nfleulJM chapter 7 through 7.3;https://web.stanford.edu/~jurafsky/slp3/7.pdf;
9
9/14/202313:25:00Training NNshttps://docs.google.com/presentation/d/1piJ4mfi2iN79n4LCl_1oUAr9oa_F0bbMnZ9SbTWP2I4/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+08-ffnn-training+CS4740+23FA/1_pj8ldyifJM chapter 7 sections 7.4, 7.6-through 7.6.2;
for more background/to go more slowly, start with JM chapter 5.4-5.6.4;		https://web.stanford.edu/~jurafsky/slp3/7.pdf;
https://web.stanford.edu/~jurafsky/slp3/5.pdf;
10
9/19/202313:25:00Pytorch tutorialhttps://drive.google.com/file/d/1arIXX97SQji1uhkIsUDanfoKAhjGcP0Q/view?usp=drive_linkhttps://vod.video.cornell.edu/media/Lecture+09_pytorch_tutorial+CS4740+23FA/1_zwdpsnw0Stanford brief notes on numpy (as well as python in general);
https://web.stanford.edu/class/cs224n/readings/cs224n-python-review-2023.pdf;
11
9/21/202313:25:00More on implementing FFNNshttps://docs.google.com/presentation/d/1l4ynvetxOBQjOMWclxVMZ-uC0N3AroFDSuWIhKs0FWI/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+10-ffnn-implementation+CS4740+23FA/1_tp9diuzwJM chapter 7 sections 7.5 and 7.7https://web.stanford.edu/~jurafsky/slp3/7.pdf;
12
9/26/202313:25:00Simple Recurrent Neural Networks (RNNs)https://docs.google.com/presentation/d/1Lo7YthxpcDL1UC3QNd1AQ4L1O--k0WH73lR1V78Zymw/edit#slide=id.g1569aa9d1ca_0_0https://vod.video.cornell.edu/media/Lecture+11-rnns+CS4740+23FA/1_9dulgr86JM chapter 9 through section 9.3https://web.stanford.edu/~jurafsky/slp3/9.pdf;
13
9/28/202313:25:00More on RNNshttps://docs.google.com/presentation/d/1G_tMd3VJA3TM5hTD0Nd5QmovGacENJ-JfrhXYBT8qns/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+12-more-rnns+CS4740+23FA/1_50kykbloJM chapter sections 9.3-9.4 and first 4 paragraphs of 9.5;https://web.stanford.edu/~jurafsky/slp3/9.pdf;
14
10/3/202313:25:00Backpropagationhttps://vod.video.cornell.edu/media/Lecture+13-backprop_notes+CS4740+23FA/1_htuefyrrNotes by TA Tushaar Gangavarapu (focus on Section 3 - and Section 4 is optional);
JM chapter 7 section 7.6;
JM section 9.1.2
https://drive.google.com/file/d/12QOvkVYv8kOaY5S00O39WY5XT475Lx8O/view?usp=drive_link;
https://web.stanford.edu/~jurafsky/slp3/7.pdf;
https://web.stanford.edu/~jurafsky/slp3/9.pdf;
15
10/5/202313:25:00Exam Reviewhttps://docs.google.com/presentation/d/1qXs-yJwM1D3I6gocegXBmcCl3EpQSnHYORiFLWpbsHc/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+14-midterm-review+CS4740+23FA/1_uhlsnw2dAnnotated version of the slides
https://drive.google.com/file/d/1I9N5ryrLPyE3au6HGhJX8kDtfRPv7jqq/view?usp=drive_link
16
10/12/202313:25:00Open Office Hours (no slides or recording)
17
10/17/202313:25:00LSTMshttps://docs.google.com/presentation/d/10fQSA_KzczXQ3onViYCr0H0ss8ECApx9ijkN6LEk_nk/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+16-lstms+CS4740+23FA/1_wf9txetfJM section 9.6;
C. Olah blog post;		https://web.stanford.edu/~jurafsky/slp3/9.pdf;
https://colah.github.io/posts/2015-08-Understanding-LSTMs/;
18
10/19/202313:25:00More on LSTMs; Encoder-Decodershttps://docs.google.com/presentation/d/1VUDZEkIFhAev7aaAwGmQeGo9zQJ9yImT2YnFPxQlF7c/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+17-lstms-encoder-decoder+CS4740+23FA/1_h27yhq4mJM section 9.7https://web.stanford.edu/~jurafsky/slp3/9.pdf;
19
10/24/202313:25:00
LSTMs and Encoder-decoders for SRL (and HW3); Attention
https://docs.google.com/presentation/d/1QkKoIFtdnhP8p7tpvKfF3q2tYSmA4y87qvUWzOnl1Iw/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+18-lstms-enc-dec-srl-attention+CS4740+23FA/1_0x1ynjnoJM 9.8; JM Chapter 10 sections 10.1, 10.2, 10.4.;https://web.stanford.edu/~jurafsky/slp3/10.pdf;
20
10/26/202313:25:00Intro to transformers https://docs.google.com/presentation/d/1GVINe-iGqpZK-XUUgqMVkClQqjuOQX79E0fwSU5kR5A/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+19-transformers+CS4740+23FA/1_jrxns3igJM sections 10.1, 10.2, 10.4https://web.stanford.edu/~jurafsky/slp3/10.pdf;
21
10/31/202313:25:00
Transformers: depth; multi-head attention; induction heads
https://docs.google.com/presentation/d/1ox7Gz3DHErwxRlPS58nBgXS0EF1exUpOKPUmzAwqdEg/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+20-transformers-and-bert+CS4740+23FA/1_8pg2a6qrJM sections 10.1, 10.2, 10.4https://web.stanford.edu/~jurafsky/slp3/10.pdf;
22
11/2/202313:25:00BERT (tentative)https://docs.google.com/presentation/d/1_wGZsWM22IAFlMAaFqsbfHXJA0X9x0WZsuuGF6llS8c/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+21-BERT+CS4740+23FA/1_qbwbu2g2JM sections 11.1-11.4https://web.stanford.edu/~jurafsky/slp3/11.pdf;
23
11/7/202313:25:00Huggingface tutorialhttps://drive.google.com/file/d/1sfUjdLfn0vp4I6SUkhQWdRbcuIrPA31H/view?usp=drive_linkhttps://vod.video.cornell.edu/media/Lecture+22_Transformers%2BHuggingFace_Tutorial.+CS4740+23FA/1_h0brx8qe
24
11/9/202313:25:00Conclusion for neural architectures; start discoursehttps://docs.google.com/presentation/d/10S7FqYAeIEkfOyR-vZmfJTpUNps2RcHtShN9t2_Fi60/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+23-conclude-neural-start-discourse+CS4740+23FA/1_3i7fz0aq
25
11/14/202313:25:00HW4 overviewhttps://docs.google.com/presentation/d/1puzzjjVrTgEaa7YzCcPIHjlzSjGb1SfcFeK9pJt2U0g/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+24-seagull-hw4+CS4740+23FA/1_rd2zim33
26
11/16/202313:25:00Discoursehttps://docs.google.com/presentation/d/192AeHzrTA7VdCcdCtAQS1WXPLZ-xP-6zp3hj3WBjbOE/edit?usp=sharinghttps://vod.video.cornell.edu/media/Lecture+25-discourse+CS4740+23FA/1_br4xktpbJM Chapter 15 through section 15.1https://web.stanford.edu/~jurafsky/slp3/15.pdf
27
11/21/202313:25:00NLP + Computational Social Sciencehttps://docs.google.com/presentation/d/1ZN4Umhps5ELXVVWl-ggYsykKV5daLFhngcS0GtLil5o/edit#slide=id.g29dd5deffa4_0_0https://vod.video.cornell.edu/media/Lecture+26-nlp-and-computationa-social-science+CS4740+23FA/1_asq5ts2d
28
11/28/202313:25:00Project sessions
29
11/30/202313:25:00Project sessions
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100