OpenRefine / SDC planning 2021-22

	A	B	C	D	E	F
1	Workflow step	If the user has ... installed, they are able to ...	OpenRefine without Commons extension	OpenRefine with Commons extension - beta version (mid 2022)	OpenRefine with Commons extension - v1.0 release (2023-ish?)	Remarks

2	01 🌟 Project creation	Let OpenRefine import a data sheet (any OR-supported format) with file paths from Wikimedia Commons	y	y	y
3	02 🚿 Data cleaning	Clean and improve a spreadsheet or dataset with file metadata	y	y	y
4	03 🔃 Reconciliation / recon	Reconcile data columns with Wikidata	y	y	y
5	03 🔃 Reconciliation / recon	Reconcile Commons file names with M-ids	y	y	y
6	03 🔃 Reconciliation / recon	Reconcile M-ids with Commons file names	y	y	y
7	04 ➡️ Reconciliation / data extension	Retrieve Wikitext (as one big blob) from existing Commons files which are reconciled in OpenRefine	y	y	y
8	04 ➡️ Reconciliation / data extension	Retrieve structured data (including captions) from existing Commons files which are reconciled in OpenRefine	y	y	y
9	06 ✍️ Editing schema preparation	Create an editing schema in OpenRefine that structures edits to files on Wikimedia Commons	y	y	y
10	06 ✍️ Editing schema preparation	Create an editing schema in OpenRefine that structures edits to Wikidata items	y	y	y	Is currently already supported in OpenRefine; user will be able to switch between (batch) editing Wikidata and Commons.
11	07 👀 Check/preview/test upload	See an example preview of the structured data that will be (batch) edited to existing Commons files	y	y	y
12	07 👀 Check/preview/test upload	See an example preview of the Wikitext (generated) infobox of files edited in batch	y	y	y	Taking into account that Lua-powered infoboxes generated from SDC can't be previewed yet
13	08 💿 Batch SDC edit	Add structured data to existing files on Wikimedia Commons	y	y	y
14	11 🤦‍♂️ Fix errors	Undo batch SDC edits to existing files	y	y	y	Using the EditGroups tool.
15	11 🤦‍♂️ Fix errors	Delete batch uploads	y	y	y	Using the EditGroups tool.
16	12 ✅ Report after upload	Download dataset with modified or uploaded file links from Commons, with their file names, M-ids, and metadata	y	y	y
17	01 🌟 Project creation	Provide OpenRefine with one or multiple Wikimedia Commons categories; OpenRefine then loads the (reconciled) file paths of all the files in these categories	n	y	y
18	10 🔺 Upload files	Upload new files to Wikimedia Commons	n	y	y	We may also decide to implement file upload in OpenRefine itself. It will certainly be possible as part of the Commons extension.
19	04 ➡️ Reconciliation / data extension	Retrieve Wikitext, split and cleaned per parameter and template, from existing Commons files which are reconciled in OpenRefine	n	p?	y
20	07 👀 Check/preview/test upload	See an example preview of the structured data that will be (batch) added to newly uploaded Commons files	n	p?	y	(not in OpenRefine core, as this will not support file upload)
21	07 👀 Check/preview/test upload	See an example preview of the Wikitext (generated) infobox of files uploaded in batch	n	p?	y
22	02 🚿 Data cleaning	Directly see thumbnails of media files while cleaning and editing their metadata	n	n	y	OpenRefine is very data-centric and does not natively support (direct) preview of thumbnails of files in its data operation screen. In a next version of the Commons extension we can, for instance, introduce a media-centric editing and viewing screen that allows end users to batch edit metadata of media files in a more visually oriented way.
23	05 📌 Metadata mapping	Map the user's dataset with a preset template / checklist of fields from Wikimedia Commons (e.g. Artwork, Book, Map...)	n	n	y
24	01 🌟 Project creation	IIIF support (retrieve and process images/files hosted on a IIIF service)	n	n	p?	We're aware of this potential use case. Needs more research
25	09 📚 Batch Wikitext edit	Edit Wikitext of existing Commons files	n	n	p?
26	10 🔺 Upload files	Upload new files to an arbitrary Wikibase	n	n	p?	Not yet, but we are taking this use case into account.
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100