Open-source RL

	A	C	D	E	F	G	H	I	J	K	L	M	N	O	P	Q	R	S	T	U	V	W	X	Y	Z	AA	AB	AC
1				Execution		Algorithms (discrete / continuous / both)													Additional features
2	Project	Maintainer	Framework	Parallel	Distributed	DQN	Rainbow	REINFORCE	A2C	PPO	DDPG	SAC	TD3	REINFORCE	A2C	PPO	TRPO	GAIL	n-step return	prioritized experience replay	distributional value funciton approximation	hyperbolic discounting	dict observations support	?
3	OpenAI baselines	OpenAI	Tensorflow	✔️	❌	✔️	❌	❌	✔️	✔️	✔️	❌	❌	❌	✔️	✔️			❌	✔️	❌	❌	❌		#REF!	#REF!	#REF!	#REF!
4	stable baselines	Antonin Raffin, Ashley Hill	Tensorflow	✔️	❌	✔️	❌	❌	✔️	✔️	✔️	✔️	❌	❌	✔️	✔️		✔️	❌	✔️	❌	❌	❌		#REF!	#REF!	#REF!	#REF!
5	Catalyst	Sergey Kolesnikov	PyTorch	✔️?	✔️	✔️	❌?	✔️	❌	✔️	✔️	✔️	✔️	✔️	❌	✔️			✔️ (any critic model)	❌	✔️ (any critic model)	✔️ (any critic model)	✔️		#REF!	#REF!	#REF!	#REF!
6	Ray.rllib	Ray Team	Tensorflow	✔️?	✔️	✔️	✔️	✔️	✔️	✔️	✔️	❌	✔️	✔️	✔️	✔️			? (DQN, DDPG only)	✔️	? (DQN only)	❌	?		#REF!	#REF!	#REF!	#REF!
7	TF agents	Google	Tensorflow	❌	❌	✔️	❌	❌	❌	✔️	✔️	✔️	✔️	❌	❌	✔️			❌	❌	❌	❌	❌		#REF!	#REF!	#REF!	#REF!
8	Horizon	Facebook	PyTorch	❌	❌	✔️	❌	❌	❌	❌	✔️	✔️	❌	❌	❌	❌			❌	❌	❌	❌	❌		#REF!	#REF!	#REF!	#REF!
9	Coach	Intel	Tensorflow	✔️?	✔️?	✔️	✔️	❌	❌	✔️	✔️	✔️	✔️	❌	❌	✔️			? (DQN only)	✔️	? (DQN only)	❌	❌		#REF!	#REF!	#REF!	#REF!
10	Garage	community	Tensorflow	✔️	❌	✔️	❌	❌	❌	✔️	✔️	❌	❌	❌	❌	✔️			❌	❌	❌	❌	❌		#REF!	#REF!	#REF!	#REF!
11	SLM-Lab	Wah Loon Keng, Laura Graesser	PyTorch	❌	❌	✔️	❌	✔️	✔️	✔️	❌	❌	❌	✔️	✔️	❌			❌	✔️	❌	❌	❌		#REF!	#REF!	#REF!	#REF!
12	Dopamine	Google	Tensorflow	❌	❌	✔️	✔️	❌	❌	❌	❌	❌	❌	❌	❌	❌			✔️	✔️	✔️	❌	❌		#REF!	#REF!	#REF!	#REF!
13	OpenAi spinningup	OpenAI	Tensorflow	❌	❌	✔️	❌	❌	❌	✔️	✔️	✔️	✔️	❌	❌	✔️			❌	❌	❌	❌	❌		#REF!	#REF!	#REF!	#REF!
14	trfl	DeepMind	Tensorflow	❌	❌																				#REF!	#REF!	#REF!	#REF!
15	scalable_agent	DeepMind	Tensorflow		✔️																				#REF!	#REF!	#REF!	#REF!
16	ELF	Facebook	PyTorch																						#REF!	#REF!	#REF!	#REF!
17	keras-rl	Matthias Plappert	Tensorflow	❌	❌	✔️	❌			❌	✔️	❌	❌			❌									#REF!	#REF!	#REF!	#REF!
18	ikostrikov	Ilya Kostrikov	PyTorch	✔️	❌	❌	❌	❌	✔️	✔️	❌	❌	❌	❌	✔️	✔️	❌	✔️	❌	❌	❌	❌	❌		#REF!	#REF!	#REF!	#REF!
19	Rainbow	Kai Arulkumaran	PyTorch	❌	❌	✔️	✔️			❌	❌	❌				❌									#REF!	#REF!	#REF!	#REF!
20	Vel	Jerry (?)	PyTorch	✔️	❌	✔️	❌			✔️	✔️	❌				❌									#REF!	#REF!	#REF!	#REF!
21	PyTorch-RL		PyTorch						✔️	✔️					✔️	✔️	✔️	✔️							#REF!	#REF!	#REF!	#REF!
22	tensorforce		Tensorflow	✔️	✔️	✔️	❌			✔️	✔️	❌				✔️?									#REF!	#REF!	#REF!	#REF!
23	RL-Adventure		PyTorch	❌	❌	✔️	✔️			❌	✔️	✔️				❌									#REF!	#REF!	#REF!	#REF!
24	DeepRL-Tutorials		PyTorch	❌	❌	✔️	✔️			❌	❌	❌				✔️									#REF!	#REF!	#REF!	#REF!
25	surreal		TorchX	✔️	✔️	❌	❌			❌	✔️	❌				✔️									#REF!	#REF!	#REF!	#REF!
26	lagom		PyTorch	✔️	❌	❌	❌			❌	❌	❌				❌									#REF!	#REF!	#REF!	#REF!
27	dennybritz		Tensorflow																						#REF!	#REF!	#REF!	#REF!
28	anyrl-py		Tensorflow																						#REF!	#REF!	#REF!	#REF!
29	scitator		Tensorflow			✔️	❌	✔️	✔️	❌	❌	❌	❌	❌	❌	❌			❌	✔️	❌	❌	❌		#REF!	#REF!	#REF!	#REF!
30	pymarl	WhiRL	PyTorch			MARL																			#REF!	#REF!	#REF!	#REF!
31	Disclaimer This list is created and maintained by Sergey Kolesnikov, inspired originally by a similar list from Dmitry Nikulin.
32
33
34
35	contacts
36	original list
37
38	https://medium.com/@vermashresth/a-primer-on-deep-reinforcement-learning-frameworks-part-1-6c9ab6a0f555
39	https://www.quora.com/What-are-some-of-the-good-Reinforcement-Learning-libraries
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100