GT CS8803-SMR: Fall 2023 Schedule Public

	A	B	C	D	E	F	G	H	I	J	K	L	M	N
1	Week	Date	Labs	Topic	Paper 1	Paper 2	P1 advocate	P1 critic	P2 advocate	P2 critic	OPTIONAL

2	1	8/21		class introduction and overview
3	1	8/23		class topic overview: Tour de SysML 2023							MLSys
4	1	8/25		registration deadline
5	2	8/28		Big ideas from ML and Systems	Berkeley View of Systems Challenges for AI	CACM12					CompSysDesign
6	2	8/30		ML Lifecycle	Hidden technical debt in ML	TFX, KDD17
7	3	9/4		LABOR DAY (no class)
8	3	9/6		ML Systems	Theano	AutoDiff in ML
9	4	9/11		Declarative ML Frameworks and Project Ideas	Tensorflow
10	4	9/13	out:1	Imperative ML Frameworks	Pytorch	Tensorflow Eager
11	5	9/18		General ML Frameworks (Ray)	ExoShuffle						Ray
12	5	9/20		Prediction Serving: Single Model	FB Inference	Clipper
13	6	9/25		Prediction Serving: Model composition	Inferline
14	6	9/27	in:1	Prediction Serving: Model Zoo	INFaaS	Clockwork
15	7	10/2	out:2	Hyperparameter Optimization	Optuna	Rubberband					HyperSched
16	7	10/4		HyperOpt continued + NAS Overview	HW-NAS Survey	darts-iclr19					NAS Survey	MNasNet-cvpr19	mobilenetv3-iccv19	proxylessnas-iclr19
17	8	10/09		FALL BREAK (no class)
18	8	10/11		Neural Architecture Search: Latency-awareness	compofa	bignas-eccv20					EfficientNet	OFA-iclr20
19	9	10/16	in:2 out:3	Resource Management for ML	Gavel-OSDI2020	DCM-osdi20					TetriSched	CoDDL
20	9	10/18		Resource Management for ML	ESCHER-socc22						Synergy-OSDI22
21	10	10/23		mid-point project presentations
22	10	10/25		mid-point project presentations
23	11	10/30		Large Language Models: Fundamentals	Orca	vLLM					Megatron-LM	Alpa
24	11	11/1	in:3 out:4	Large Language Models: Efficient Scaling	Sarathi
25	12	11/6		Large Language Models: Breaking HW Limitations	Spec Decode	Towards MoE
26	12	11/8		Federated Learning	FL@Google	FedML					FedAvg	FL@Scale@Google
27	13	11/13		Serverless Frameworks for ML	Serverless Computing: One Step Forward, Two Steps Back	FaasML					Cirrus
28	13	11/15		Cyber-physical systems: SysML challenges & opportunities	Pylot	D3
29	14	11/20	in:4	final project presentations
30	14	11/22		STUDENT RECESS (no class)
31	15	11/27		final project presentations
32	15	11/29		final project presentations
33	16	12/4		final project presentations
34
35		DATES
36		10/28		withdrawal deadline
37		12/4-5		final instructional days
38		12/8		final project video/demo due by 2359ET
39		12/10		final project report due by 2359ET
40		12/18		grades due by noon
41				QUIZ (tentative)
42
43	Bonus Topics			ML Compilers	TVM
44				ML Frameworks	Mxnet	XGBoost
45				Model Compression	Squeezenet	Rethink net pruning	shufflenet
46				Reinforcement Learning (Brief Intro) + Concluding Remarks	Distrib RL ICLR18
47				Mixed Precision DNN	PWLQ-eccv20	MixedPrecDNN-mlsys21
48				guest lecture: Distributed Training	FlexFlow@MLSys19	BlueConnect
49				guest lecture: Distributed Training	EFLOPS@HPCA20	ISCA20
50				Graph Neural Networks: Systems & Efficiency
51				AI for healthcare: SysML opportunities	HOLMES-kdd20	unfoldml-neurips22					DL4EHR Survey	DL4ECG
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100