ABCDEFGHIJKLMNOPQRSTUVWXYZ
1
2
All assignments are due on Fridays at 5pm Pacific
3
ReadingAdvanced Topics not on Quizzes
4
Week 123-SepIntroduction1
5
24-SepProblem session: Probability review (Jack)
6
25-SepRepresentation2
7
Week 230-SepInference33.4, 3.5, 3.8
8
1-OctProblem session: Bayesian networks, representation and inference (Shreya & Brian)
9
2-OctParameter Learning44.4
10
3-OctDue: Project 0 and Quiz 0 (late deadline Oct 10, 5:00pm), OAE letter (if applicable)
11
Week 37-OctStructure Learning55.3, 5.4
12
8-OctProblem session: Quiz 1 review session (Mykel)
13
9-OctSimple Decisions6
14
10-OctDue: Quiz 1 (90 minutes, opens Thurs 5pm, due Fri at 5pm)Covers 2-5
15
Week 414-OctExact Solutions77.7, 7.8
https://github.com/mossr/PlutoNotebooks/blob/master/value_iteration.jl
16
15-OctProblem session: Exact solution methods (Jun)
17
16-OctApproximate Value Functions88.5
18
17-OctDue: Project 1Covers 4-5
19
Week 521-OctOnline Planning and Policy Search9-109.7, 9.8, 9.9, 10.3, 10.5, 10.6
https://drive.google.com/file/d/19OVXd6oQfbaUMTTM1JbToIpCkBf9plh1/view?usp=sharing
20
22-OctProblem session: Policy Search (Neha)
21
23-OctPolicy Gradient Estimation and Optimization11-1211.4, 11.5, 12.3, 12.4, 12.5
https://drive.google.com/file/d/1A8WttwXS47ZiLod_im116LMCcOkP8dKI/view?usp=sharing
22
24-OctDue: Project proposal
23
Week 628-OctActor Critic and Exploration and Exploitation13, 1513
https://drive.google.com/file/d/1ClEcWzp4egBXqq9MgaSNll3_sbNmxsGb/view?usp=sharing
24
29-OctProblem session: Quiz 2 review session (Mykel)
25
30-OctModel-Based and Model-Free Reinforcement Learning16-1716.5, 17.4, 17.5, 17.7
26
31-OctDue: Quiz 2 (120 minutes, opens Thurs 5pm, due Fri at 5pm)Covers 6-12
27
Week 74-NovNO CLASS: Democracy Day: day of civic service
28
5-NovProblem session: Reinforcement Learning (Jessica)
https://www.overleaf.com/read/fdxnzxgcqttd#77c23b
29
6-NovBeliefs1919.3, 19.4, 19.5, 19.7
30
7-NovDue: Project 2Covers 16-17
31
Week 811-NovExact Belief State Planning2020.6
32
12-NovProblem session: Beliefs (Sukeerth/Arec)
33
13-NovOffline Belief State Planning2121.6, 21.8, 21.9
34
14-NovDue: Project status update
35
Week 918-NovOnline Belief State Planning2222.6, 22.7
https://drive.google.com/file/d/14RHxxwfUKQ5l5ND71Rnlyk9MXJ6_tIE8/view?usp=sharing
36
19-NovQuiz 3 review (Mykel)
37
20-NovController Abstractions and Multiagent Reasoning23-24
https://drive.google.com/file/d/1C1Ml9v9fLrYDFKl3o25NHatTtNQLxwh5/view?usp=sharing
38
21-NovDue: Quiz 3 (180 minutes, opens Thurs 5pm, due Fri at 5pm)Covers 19-22
39
Week 102-DecPolicy Validation, Implications, and Summary14
40
5-DecDue: Final project paper or video
41
Finals Week15-DecDue: Peer review
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100