1 of 44

WELCOME TO OUR WIKI SHOWCASE!

  • 11:30am to 12:45pm – WIKIDATA SHOWCASE (Pentland West).
      • Navino Evans, Wikidata Volunteer and Co-founder of Histropedia.
      • Ewan McAndrew, Wikimedian at Edinburgh University.
  • 2.15pm to 3pm – WIKIDATA – ADVANCED QUERY WORKSHOP (Holyrood).
      • Navino Evans, Wikidata Volunteer and Co-founder of Histropedia.
      • Ewan McAndrew, Wikimedian at Edinburgh University.

2 of 44

Please create an account on Wikidata

3 of 44

Wikidata

The free and open knowledge base

Repo Fringe 2016

Ewan McAndrew - @emcandre

Navino Evans - @NavinoEvans

Link to presentation

http://tinyurl.com/gtc7o2p

4 of 44

Google had its own free and open knowledge base… Freebase

5 of 44

Google sunsets Freebase – its own structured data repository.

6 of 44

This means that Google’s ‘Knowledge Graph’ is now powered, not exclusively but ever increasingly, by Wikidata.

“The primary issue with Google’s knowledge panels is that they aren’t terribly knowledgeable: They provide information but often leave out any context on where that information came from….”

Caitlin Dewey, The Washington Post – 11 May 2016

7 of 44

The need for digital provenance

“Since Google frequently does not cite its sources…. there’s no way for users to double-check “answers” for bias or error, which doubtlessly exist.”

Caitlin Dewey, The Washington Post – 11 May 2016

8 of 44

Wikidata – the new Rosetta Stone

“Data is beautiful. Data is information.”

9 of 44

Wikidata

Wikidata is a free linked database of knowledge that can be read and edited by both humans and machines.

Wikidata acts as central storage for the structured data of its Wikimedia sister projects including Wikipedia, Wikivoyage, Wikisource, and others.

10 of 44

  • repository of the world's knowledge
  • database anyone can read and edit
  • multi-lingual
  • designed to deal with the reality Wikipedia has to deal with
  • free and open source software.
  • All data on Wikidata is CC-0 licenced.

What is Wikidata actually?

11 of 44

English Wikipedia “only includes only includes 30% of the items entered in the other 287 languages.”*

“The promise of linked open data seems to have finally arrived.”

12 of 44

a powerful machine-

readable dictionary

a powerful machine-

readable dictionary

picture by Ealgyth

13 of 44

Example Wikidata item & statement

Douglas Adams

14 of 44

The Map (2014)

15 of 44

8 January 1947

David Bowie (Q5383)

date of birth (P569)

16 of 44

9,747,355

according to: Statistics Sweden

method: estimation

point in time: 31 Dec 2014

picture by Hector Melo A.

Sweden (Q34)

population (P1082)

17 of 44

48°51‘30"N

2°17‘40"E

picture by Wladyslaw

The Eiffel Tower (Q243)

coordinate location (P625)

18 of 44

All available DataTypes

  • Item
  • String
  • Time
  • Globe co-ordinate
  • URL
  • Quantity

Datatypes are used in statements to represent data

  • Commons media
  • Monolingual text
  • External identifier
  • Property
  • Mathematical expression

19 of 44

Wikidata key stats – data and community

  • 38,7 million items
  • 100 million statements

  • 595,6 million edits
  • 16,500 active editors

Growth of statements and references since launch

Date retrieved 18st Nov 2017

20 of 44

The Map (2014)

21 of 44

The Map (2015)

22 of 44

The Map (2016)

23 of 44

What all this Linked Data means….

  • Using Wikidata we can now query Wikipedia as never before.

e.g. Show me all the architects with UK Citizenship grouped by place of education.

  • The Wikidata game gamifies the experience of adding an item to improve Wikidata a little at a time, simply & easily.

  • Inventaire builds on Wikidata by allowing people to share their favourite books, thereby adding to the open knowledge on books & authors.

  • The BFI, MOMA and Ted Talks are all now migrating their data to Wikidata. Finnish broadcaster YLE are also migrating their data to Wikidata.

24 of 44

Mona Lisa – Wikidata item Q12418

25 of 44

Identifiers.

26 of 44

List of paintings by Jacob van Ruisdael�(Part of Sum of All Paintings project)

27 of 44

First task is to use Metadata for 3000 images from the Welsh Landscape collection, which are available on Wikimedia Commons, to create detailed linked data……

then work with the Library and volunteers in the Wikidata community to explore new ways of exploring and analysing the data and associated images.”

National Library of Wales have a Wikidata Visiting Scholar. A world first.

28 of 44

29 of 44

SPARQL endpoint for querying Wikidata

Who’s birthday is today?

Useful links

Wikidata Query Service Beta – Official query service

SPARQL Query Examples

WDQ – Third party query service which is simple to learn

30 of 44

Practical session – Let’s improve Wikidata!

What are we doing?

Adding some missing data to Wikidata items for ‘Women who were educated at Edinburgh University’

What data to add?

Our practical session will focus on adding the place of birth (P19)

31 of 44

Practical session – Instructions

Adding birth locations (P19)

List of items with missing birth place →

Finding the data

  • Click on link above and click “run” when you arrive on the page
  • Click on Wikidata link for any item (rightmost column in results)
  • Click on link to the Wikipedia article (from Wikidata item page)
  • Find the birth location (if present) – use the most precise location you can find (e.g. choose an area within a city over the city itself)
  • Go back to your Wikidata item page

Adding the statement

  • Scroll to bottom of the page and click “+ add”
  • Type “place of birth” in the “property” box
  • In the box to the right, type in the location and select from the dropdown results
  • Click save to add the statement to the item

32 of 44

How to get data from Wikidata

  • Data dump

Large scale download/processing of data

  • API

Get data on individual or small groups of items

  • SPARQL endpoint

Run advanced queries

See main data access page for a complete overview

33 of 44

Example Applications

All generated using the data stored in Wikidata

34 of 44

35 of 44

36 of 44

Ask Platypus

askplatyp.us

37 of 44

ConceptMap

38 of 44

39 of 44

40 of 44

Visualising results from practical

On the Wikidata Query Service…

Women educated at Uni of Edinburgh query

Multiple visualisations available after loading and clicking run

On the Histropedia Query Timeline app,

using the Wikidata Query Service…

Colour coded by place of birth (P19)

41 of 44

THANKS FOR LISTENING – ANY QUESTIONS?

42 of 44

Links and further reading

43 of 44

Developer links

#wikidata on chat.freenode.net

wikidata-l@lists.wikimedia.org

Wikidata – The New Rosetta Stone (article).

Google closes Freebase (article).

Google’s sketchy attempt to control the world’s knowledge (article).

api @ wikidata.org/w/api.php

sandbox @ wikidata.org/wiki/Special:ApiSandbox

The Wikidata Game: https://tools.wmflabs.org/wikidata-game/distributed/

PHP

Wikibase API Library: github.com/addwiki/wikibase-api

SPARQL abstraction: github.com/Benestar/asparagus

Python

Wiki bot Framework: mediawiki.org/wiki/Manual:Pywikibot/Wikidata

C# .NET

Wikibase API Library: github.com/Benestar/wikibase.net

44 of 44

WANT MORE WIKIDATA?�

Join us later for the Wikidata Advanced Query Workshop at 2.15pm

  • 2.15pm to 3pm – WIKIDATA – ADVANCED QUERY WORKSHOP (Holyrood).
      • Navino Evans, Wikidata Volunteer and Co-founder of Histropedia.
      • Ewan McAndrew, Wikimedian at Edinburgh University.