Tools, workflows, pain points - GLAM, structured data, Structured Commons
 Share
The version of the browser you are using is no longer supported. Please upgrade to a supported browser.Dismiss

 
Comment only
 
 
ABCDEFGHIJKLMNOPQRSTUVWXYZAAABACADAEAFAG
1
WELCOME to this spreadsheet! What to do here?
* Tool developer: are your tools represented correctly? Please edit if that is not the case.
* Active tool user (1): Please check if your favorite tools are in this sheet and if not: leave a comment or add them directly.
* Active tool user (2): Indicate the importance of your favorite tools in the pink column 'Importance'. Please add comments with extra input too!
Thank you! Confused? Ask Sandra (sfauconnier@wikimedia.org)
About this spreadsheet
* Covers a mix of GLAM tools, Commons tools and Wikidata tools; many, but not all, with some relation to Structured Commons
* Goal 1: general overview of all relevant tools out there. If tools are missing, please leave a comment.
* Goal 2: track down tools needing attention in the transition to Structured Commons
* Goal 3: generally make more sense of the tool ecosystem that supports GLAM and other partnership projects
The most important tools are listed on https://commons.wikimedia.org/wiki/Commons:Structured_data/Get_involved/Tools and receive Phabricator / Github tickets to keep track of necessary updates.
Sources used for this spreadsheet:
* Sandra's memory and bookmarks
* List of Commons gadgets in user preferences
* Magnus' version of Hay's tool directory - subcategory Commons and GLAM
* https://commons.wikimedia.org/wiki/Commons:Upload_tools
2
Phab taskProjectType of applicationStep in workflowDomainPrioritizationConversion needs
3
🛠code here
GAP = needed but
we don't have it yet
descmaintainer(s)
Wikidata
Commons (old)
Commons (structured)
p = has potential
Gadget
Script
Toolforge
On external website
Standalone software
get source media / metadata
source data cleaning
matching with Wikidata
media upload
data upload
enhance -
categorization
admin / moderation
curation / organization
bulk / quick editing
generate attribution
statistics (Commons)
statistics (Wikidata)
reuse / visualization
search
GLAM
Structured Commons
AllOurIdeas survey rank
Importance
Explanation
Y > Phab task link
O: will become obsolete
Comments
4
CatScanTool replaced by PetScanMagnus Manske(n/a)1 - Unimportant
5
Wikimedia CH's metrics tool?y(n/a)
6
Cat-a-lothttps://commons.wikimedia.org/wiki/MediaWiki:Gadget-Cat-a-lot.jsgadget that helps with moving images (or subcategories) between categories or adding categories to search resultsPerhelionnyyy904 - Importantn/aThe information in categories will preferably be translated to structured data. Old category functionality will, most likely, not change.
7
HotCataugments the category bar with quick links to remove, change, or add categoriesWritten by Magnus Manske. Maintained by community (Lupo, WMF, etc.)nyyy88.13564 - Importantn/aThe information in categories will preferably be translated to structured data. Old category functionality will, most likely, not change.
8
GLAMorousTrack usage of media files on other Wikimedia projectsMagnus Manskenyyyyyy80.9524
9
GLAMorous2Track reuse of media files on Wikimedia projects, incl. PagePileMagnus Manskey77.1429
10
UploadWizardhttps://www.mediawiki.org/wiki/Extension:UploadWizardSingle to 50 file upload (simple) to Commonsypyyy76.36365 - CRUCIAL
Rethinking for SDC needed
? will become obsolete / rethinking needed for structured uploads
11
Advanced search (Commons)https://commons.wikimedia.org/wiki/MediaWiki:Gadget-advanced-search.jsImproves advanced search by adding options suitable for commonsBawolffnyyy76.2712
12
CropToolAllows online cropping of imagesDan Michael O. Heggønyyyy74.0741
13
Petscanhttps://bitbucket.org/magnusmanske/petscan
Swiss army knife for listing and handling Wikimedia content via Wikidata, categories, templates etc
Magnus Manskeyypyyyy73.68424 - Important
14
Image annotationsAllowes Image annotation by adding rectangles with text.Lupoyyy73.33333 - MediumShould become part of structured data
15
VisualFileChangehttps://commons.wikimedia.org/wiki/MediaWiki:VisualFileChange.jsBulk editing on Commonsnypyyyyy725 - CRUCIALThs tool might need to be rewritten. It is very usefull for mass adding problem tags to images ir performing find and replace operations on a batch of files
16
Copyright calculatorGAP
Functionality that helps uploaders determine the copyright status of the material they attempt to upload
n/aypyy70.96773 - Medium
17
Video2Commonshttps://github.com/toolforge/video2commonsVideo upload and conversion toolZhuyifei1999ypyy70.3704
18
Wikimedia Pageviewshttps://github.com/MusikAnimal/pageviewsPageviews for Wikipedia articles, but also Commons pagesMusikAnimal, Kaldari, Marcel Ruiz Fornsyyyy69.3878
19
CommonsHelperTransfer images from Wikipedias to CommonsMagnus Manskeypyyy68.88894 - Important
20
GLAMorgantracks pageviews of commons images in a specific categoryMagnus Manskenyy68.4211
21
Massviews(part of Pageviews) view stats for categories or groups of pagesMusikAnimal, Kaldari, Marcel Ruiz Fornsyyyy66.0377
22
DeepCatBetter search in categories.yy65.0794
23
Listeriahttps://bitbucket.org/magnusmanske/listeriaGenerates on-wiki dynamic lists based on Wikidata queriesMagnus Manskeyypyy654 - Important
24
BaGLAMa2Monthly view counts for Wikimedia pages containing Commons mediaMagnus Manskenyyy64.9123
25
Commons video convertUpload video files (many formats)Prolineservernyyy64.8148
26
Flickr2Commonshttps://bitbucket.org/magnusmanske/flickr2commons
Media upload from Flickr site. Similar to UploadWizard ability to upload from Flickr but can be used by anybody.
Magnus Manskenypyy64.28574 - Important
27
RotateLinkOnline tool to rotate an image by increments of 90 degreesyy62.85714 - ImportantShould not be affected by Structured data
28
ZoomViewerZoom functionality for images > 2 megapixelsDschwenyyy62.069
29
TreeViewsMonthly view stats for category treesMagnus Manskeyyyy61.2245
30
File ReuseDrag&drop attribution generatorMagnus Manskeypyy60.4651
31
search -incategory (Commons)
Adds a link to category pages to search for the category name with the option "-incategory". This excludes files already in the category
yy59.6774
32
ComeOn!https://github.com/edouardhue/comeontool for importing pictures or sound clips to Wikimedia CommonsEdouard Hueyyy59.5745
33
RenameLinkA gadget to add a link “Move” to file pages' action menusyy59.57454 - Important
34
Commons APIExperimental Commons API for author and media dataMagnus Manskeyyy59.2593OCommons' own API will change a lot with the arrival of Structured Commons
35
WikiShootMehttps://bitbucket.org/magnusmanske/wikishootme/
A tool to show Wikidata items, Wikipedia articles, and Commons images with coordinates, all on the same map
Magnus Manskeyypyy59.25933 - Medium
36
Changes CheckerGAPTo structurally keep track of changes and updates to a specific uploadn/ayp58.9286
37
Monumentalhttps://github.com/hatnote/monumentalMap and upload monumentsYarl/Pawelyypyyyyyy58.92863 - Medium
38
WikiMiniAtlas
JavaScript plugin to display a draggable, zoomable, and clickable worldmap in geocoded Wikipedia articles
yy58.92863 - MediumMight get superseeded by Kartograph or other map applications
39
3D2CommonsGAPMake it easy to upload 3d files to Wikimedia CommonsSNHB and WMSEypyyy57.7778Will be developed in near time by the Swedish National heritage Board and Wikimedia Sverige
40
AutoWikiBrowsersemi-automated MediaWiki editor. Can be used for writing bot scripts and deleting pagesnyyyyy57.77783 - Medium
41
For the Common Goodhttps://github.com/atlight/ForTheCommonGoodstandalone software for transferring files from Wikipedia to Wikimedia CommonsUser:This, that and the otheryy56.09762 - Minor importanceRarely used tool trying the imposible task of converting wikipedia file description to Commons file description
42
bigChunkedUploadHelps with the upload of large filesyyy55.9322
43
QuickStatements2https://phabricator.wikimedia.org/source/tool-quickstatements/Batch uploading data to WikidataMagnus Manskeynpyyyyy55.93225 - CRUCIALYPreferably to become core Commons functionality? Must be possible to undo and discuss batches of edits (unlike with current QuickStatementsBot). See discussion on wiki
44
WdFISThttps://bitbucket.org/magnusmanske/fist/src/373d68e52a8ffffd4cea2501d32b4befb80180ea/public_html/wdfist/?at=masterFree image search for WikidataMagnus Manskeyypyyy55.93223 - Medium
45
FastCCIImproved category searchDschwennyyy55
46
FISThttps://bitbucket.org/magnusmanske/fist/srcFree Image Search ToolMagnus Manskeypyy55
47
Add {{Information}}https://bitbucket.org/magnusmanske/add_informationAdd {{Information}} template to file on CommonsMagnus Manskenyyyy54.68752 - Minor importanceTool does not work well as it was not updated in a long time.
48
Reasonatorhttps://bitbucket.org/magnusmanske/reasonatorWikidata in pretty (friendly layout)Magnus Manskeynpyy54.3478
49
AjaxQuickDeletehttps://commons.wikimedia.org/wiki/MediaWiki:Gadget-QuickDelete.js
Adds useful links to tag files as missing source/license/permission or for deletion, and notifies users accordingly
nyyyy54
50
User Messages
A gadget which provides links to easily leave standardised messages for users via common message templates
yy53.4884
51
CatScan2-linkAdds prefilled link to Petscan tool for Category pagesnyyy53.03031 - Unimportant
52
SynchronizerGAPTo synchronize external data/media sets and the content available on Wikimedia projectsn/ayp52.9412
53
Command-line upload toolsVarious tools to upload media to Commons via the command lineyyy52.459
54
Wikimaps Warperhttps://github.com/wikimaps-dev/mapwarperMap georeferencing toolChippyyypyyy52.17393 - MediumYCan be used as is and take advantage of structured data for Commons or would benefit from refactoring into a more lightweight tool
55
Mix’n’matchhttps://bitbucket.org/magnusmanske/mixnmatchMatch external datasets to WikidataMagnus Manskeynpyyyyp51.78575 - CRUCIAL
56
Wikidata SPARQL Recent Changeshttps://bitbucket.org/magnusmanske/wikidata-todoSee changes to items in a SPARQL query over a given timeframeMagnus Manskeypyyy51.2195
57
Page PurgeAdds page "purge" option to menusyy51.11111 - Unimportant
58
GLAM2commonshttps://github.com/infobliss/sibutest2Single file uploaderBasvb, Infobliss, Zhuyifei1999 nypyy50.94343 - Medium
59
GallerypreviewPreviews categories and galleries when viewing an image.yyy50.8772
60
GalleryFilterExtension
Creates a select to filter image galleries, including categories containing images, by file-extension.
yyy50
61
Pattypanhttps://github.com/yarl/pattypanUpload files from spreadsheetYarl/Pawelnypyy505 - CRUCIALYAlso posted issue on Github: https://github.com/yarl/pattypan/issues/49
62
Programs & Events Dashboardhttps://github.com/WikiEducationFoundation/WikiEduDashboardStats of page edits, editor retentionWMF Community Techyyy50
63
Wikimedia Commons Android apphttps://commons-app.github.io/Mobile application for Wikimedia Commonshttps://github.com/commons-app/apps-android-commons/graphs/contributorsypyyyyy50
64
Gallery DetailsDisplays files next to the content of the file pages for a categoryyyy49.2063
65
VicuñaUploaderhttp://yarl.github.io/vicuna/Open source desktop tool for uploading media to CommonsYarlyyy49.05664 - Important
66
Recent acquisitionshttps://github.com/hay/wiki-toolsShow newest pages in a categoryHayy48.9796
67
Quick Delete
Adds useful links to tag files as missing source/license/permission or for deletion, and notify users accordingly
yyyy48.3871
68
url2commonshttps://bitbucket.org/magnusmanske/url2commonsTransfers files from list of URLs to CommonsMagnus Manskeypyy48.21433 - Medium
69
GLAMifyImage suggestions for WP articles based on other language WPIjon/Asafyyyy47.0588
70
PermissionOTRSAutomatically add {{PermissionOTRS}} or {{OTRS received}} to a media fileyyyy47.0588
71
Dezoomifyhttps://github.com/VDK/DememorixerLarge image downloads from Zoomify-powered websiteslovasoanyyy46.05262 - Minor importance
Download tool. Does not depend on structured data per se
nDownload tool. Does not depend on structured data per se
72
PywikipediabotPython library and collection of tools that automate work on MediaWiki sitesyyy45.58824 - Important
73
Commons Android mobile apphttps://github.com/commons-app/apps-android-commonsSmartphone app that supports uploads to Wikimedia Commonshttps://github.com/commons-app/apps-android-commons/graphs/contributorsypyy45.16133 - MediumY
74
SQID Wikidata Browserhttps://github.com/Wikidata/SQID.gitBrowsing Wikidata properties and classesTU Dresdenypyyyy45.0984 - Important
75
Lizenzhinweisgeneratorhttps://github.com/wmde/LizenzhinweisgeneratorGenerates correct attributionWMDEyyy44.8983 - MediumYSF: Better if this becomes built-in functionality in Commons, especially once structured licenses are in place?
76
Thumbnail Purge (Commons)
Forces Commons to recreate a page from its database, rather than relying on a "cached" version of the page
yy44.2308
77
ImprovedUploadForm2007 "improved" upload tool. Likely made obsolete by newer upload tools and UploadWizardLupo & communityyyy44.1861 - Unimportant
78
What Is That / MultiDescGenerates multi-language descriptions for galleries or images on CommonsMagnus Manskeyy44.1862 - Minor importanceThis gadget never worked for me. Does it work for others?
79
ia-uploadhttps://github.com/wikisource/ia-uploadImportation tools for books scans from Internet ArchiveS. Wilson, Tpt (and more broadly the Wikisource communityypyyyy44.0678
80
Pagepilehttps://bitbucket.org/magnusmanske/pagepileCreate lists of Wikidata items so that you can do stuff with thoseMagnus Manskeyypyyp43.75
81
GWtoolsethttps://github.com/wikimedia/mediawiki-extensions-GWToolsetXML-based mass upload tool to Commonsnyy43.4783OGWtoolset to be abandoned with Structured Commons? (SF/Liam discuss with Europeana)
82
Global Usage Badgesgadget that shows badge on commons images used in other projectsyy43.1818
83
Unused filesFind files in a Commons category tree not used on WikipediaMagnus Manskey43.1034
84
Locator tool
https://github.com/simon04/locator-tool/
add {{Location}} or {{Object location}} to images on Wikimedia Commons
Simon Legner @simon04
yyyy42
85
GLAMpipehttps://github.com/artturimatias/GLAMpipeSwiss army knife for data wranglingSusanna Anas, Ariyypyyyyyyyyyyyyy41.50944 - Important
86
Wikipedia tools for Google Spreadsheetshttps://github.com/tomayac/wikipedia-tools-for-google-spreadsheetsGoogle Spreadsheet plugin to do all sorts of stuff with Wikipedia and Wikidata infoTomayacyypyyyyy41.50944 - Important
87
A generic muggle scraperGAPTo allow muggle volunteers to scrape external websitesn/aypyyy40.8163
88
MTC!https://github.com/fastily/mtcstandalone software for transferring files from Wikipedia to Wikimedia CommonsUser:Fastilyyy40.4255Rarely used tool trying the imposible task of converting wikipedia file description to Commons file description
89
Commonisthttps://github.com/ritschwumm/commonist/issues/newJava file upload tool form 2006. Precursor to to VicuñaUploader and Pattypanyyy403 - MediumCommunicates through Commons API
90
Popups (Commons)Navigation tool that offers popup preview windowsyy40
91
Slideshow
A gadget that provides JavaScript code to create a slideshow of the images within a category or in a gallery on a page in the Commons: or Gallery: namespaces. Enabled by default
yy39.6552
92
OpenRefinehttps://github.com/OpenRefine/OpenRefineData wrangling, Wikidata matchinghttps://github.com/OpenRefine/OpenRefine/graphs/contributorsypyyyyyyyyy39.28574 - Importantgetting source metadata is being worked on now in this issue https://github.com/OpenRefine/OpenRefine/issues/1096 Our bulk edit support could be enhanced and the OpenRefine team has some ideas. Enhance/categorization is implemented through pulling down more data from Wikidata on columns once reconciled. https://github.com/OpenRefine/OpenRefine/wiki/Reconciliation#fetching-values-from-the-reconciled-database
93
GoogleImages tab
adds a tab on File pages which links to the Google Images website for a reverse image search on that file
yyy38.4615
94
Geocoding toolsAdds three geocoding links to the toolbox: recent changes, daily error log, and search.yyy38.0952
95
Wikidata distributed gamehttps://bitbucket.org/magnusmanske/wikidata-game/src/master/public_html/distributed/?at=masterSmall games to improve WikidataMagnus Manskeynpyyy37.0374 - Important
96
StockPhotohttps://commons.wikimedia.org/wiki/MediaWiki:Gadget-Stockphoto.jsshows download and attribution buttons on Commons File pagesunmaintainedyyyy36.58542 - Minor importanceShould become absolete, but requires transition. Make it support the commons metadata api ?
97
GEDCOM importerGAPA program that takes a GEDCOM file with genealogical data and imports it into Wikidatayy36.5385
98
Geograph2Commonshttps://bitbucket.org/magnusmanske/geograph2commonsUploader from geograph.co.ukMagnus Manskeypyy33.8713 - MediumSF: would like to know / find out how often this tool is used
99
VIAFDataImporter
Fetches Authority Control identifiers from VIAF and adds them to a {{Authority Control}} template
Inductiveloadyyyy33.33331 - UnimportantMostly unmantained. The tool dod not work for some users for years, but it worked for others. It lost its importance when we start to keep most authority control data on Wikidata. There is Wikidata version of this tool.
100
Wikidata edit statisticshttps://bitbucket.org/magnusmanske/wikidata-todoShow edits of items in a SPARQL queryMagnus Manskeypyyy32.8358
Loading...
Main menu