Data science workflow tools
 Share
The version of the browser you are using is no longer supported. Please upgrade to a supported browser.Dismiss

 
View only
 
 
ABCDEFGHIJKLMNOPQRSTUVWXYZAAAB
1
The tools below are categorized according to their applicability within the 6 core processes of the data science workflow, as defined in this blog post:
2
http://fouryears.eu/2018/11/29/the-data-science-workflow/
3
The list does not claim to be an all-encompassing survey. This is just a sample of tools and services known to the author
4
Workflow stages
5
TitleLink
Pricing /
License
Github
stars (Nov'18)
Data
management
Compute
graph
Experiment
management
DeploymentMonitoring
Workbench
organization
6
Any database server or file format
N/AN/Ax
7
Git LFS
https://git-lfs.github.com/
MIT6488x
8
Git Annex
https://git-annex.branchable.com/
AGPLN/Ax
9
Quilt
https://quiltdata.com/
Freemium684x
10
GNU Make
https://www.gnu.org/software/make/
GPLN/Ax
11
Luigi
https://github.com/spotify/luigi
Apache10529x
12
Airflow
https://github.com/apache/incubator-airflow
Apache10086x
13
DVChttps://dvc.org/Apache1523xx
14
ModelDB
https://github.com/mitdbg/modeldb
MIT573x
15
CometML
https://www.comet.ml/
FreemiumN/Ax
16
Sacred
https://github.com/IDSIA/sacred
MIT1404x
17
Hyperdash
https://hyperdash.io/
Free110x
18
Sumatra
https://github.com/open-research/sumatra
BSD81x
19
FGLab
https://kaixhin.github.io/FGLab/
MIT170x
20
TensorFX
https://github.com/TensorLab/tensorfx
Apache178x
21
TensorBoard
https://github.com/tensorflow/tensorboard
Apache2840x
22
Weights and Biases
https://www.wandb.com/
FreemiumN/Ax
23
DatMo
https://github.com/datmo/datmo
Apache179xx
24
Neptune
https://neptune.ml/
FreemiumN/Axx
25
Pachyderm
http://www.pachyderm.io/
Apache3267xxx
26
Tensorflow Serving
https://www.tensorflow.org/serving/
Apache2843x
27
SKompiler
https://github.com/konstantint/SKompiler
MITN/Ax
28
JPMML/jpmml-sklearn
https://github.com/jpmml
AGPL258x
29
AWS Lambda
https://aws.amazon.com/lambda/
PaidN/Ax
30
Acumos
https://www.acumos.org/
PaidN/Ax
31
MLFlow
https://www.mlflow.org/
Apache2674xxx
32
YHat
http://docs.yhat.com/
PaidN/Axx?
33
Grafana
https://grafana.com/
Apache25175x
34
Metabase
https://www.metabase.com/
AGPL12314x
35
Tableau
https://www.tableau.com/
PaidN/Ax
36
MyDBR
https://mydbr.com/
FreemiumN/Ax
37
Cookiecutter-DS
http://drivendata.github.io/cookiecutter-data-science/
MIT1649x
38
Lore
https://github.com/instacart/lore
MIT1247xxxx
39
FloydHub
https://www.floydhub.com/
Freemium109xxxx
40
AzureML
https://studio.azureml.net/
PaidN/Axxxx
41
Dataiku
https://www.dataiku.com/dss/
PaidN/Axxxxx
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
Loading...
Main menu