1 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Begin - The State of the Art - Part 1

2 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Chris Fleet, National Library of Scotland

3 of 136

National Library of Scotland : historic maps and viewers

91,000 online maps

600 georeferenced layers

OpenLayers

GeoServer

MapTiler

JQuery

QGIS

4 of 136

National Library of Scotland : Web Services

Great Britain Historical Maps API

TMS / WMS / WMTS

OpenStreetMap historic layers

Google Maps Gallery content

5 of 136

National Library of Scotland - Collaborative projects Vectorising features

AddressingHistory - Post Office Directories

Visualising Urban Geographies

MESH (Mapping Edinburgh’s Social History)

Chris Fleet, National Library of Scotland - c.fleet@nls.uk - http://maps.nls.uk

6 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Bill Ferster, University of Virginia

7 of 136

8 of 136

Maps as Objects | Maps in Context | Maps in Spaces

MapScholar makes it easy to:

  • Create interactive collections of historic maps
  • Explore, compare, contrast, and annotate maps
  • Publish narrated tours through map collections
  • Walks the continuum between exhibition and exploration
  • HTML5-based /open-source, supports web standards
  • Connect interactive map explorations with published texts

Bill Ferster | Max Edelson | University of Virginia

www.mapscholar.org

9 of 136

KML Overlays on maps

Very hi-res tiled historic maps

Easy to use authoring tool

Fast /easy geo-referencing of maps

3D shows underlying terrain

Fast / easy choropleths

10 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Tonia Sutherland, University of Pittsburgh

11 of 136

Collaborative Goals:

  • link social sciences to each other and to the principal problems in human society, at scales from the local to the global over the past four centuries and into the future
  • encourage a culture of data sharing among social scientists
  • develop a global, integrative repository and analytical framework supporting specific research projects on four domains of social life: human-natural interaction, population change, development of socio-economic inequality, and local and global governance
  • develop a strong and expanding research team which will unleash a rapid inflow of historical data to be documented and archived
  • develop an expanding system of metadata and ontology to describe data and assist in their integration and aggregation
  • conduct interactive analysis at regional and global levels of variables in social sciences, health, and climate

12 of 136

13 of 136

14 of 136

15 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Karl Grossner, Stanford University

*

16 of 136

(use cases for)�Historical Geodata on the Web

Karl Grossner

Digital Humanities Research Developer

Stanford University Libraries

17 of 136

Building Inspector is an object lesson in how to digitize old maps: a set of maps, a clear circumscribed purpose, a highly usable system, institutional support

Open Historical Map

Get your �(old) map on!

The ORBIS

of Everywhere

And When

USGS

Historical

Topo Maps

Your historical

mapping project �here

??

??

18 of 136

http://orbis.stanford.edu

October, 2014

640,000 users since May 2012

19 of 136

Q: What about an ORBIS of ______ ?

A: Of course, let’s do it!

Q: Why not yet?

A: Need data, time and $$, and if it’s to be shared, hosts and a standard or two

  • A global, open digital historical atlas of transportation: the circulatory system for human movement on earth
  • Linked networks of roads, rivers, �sea routes, imputed paths, journeys
  • World-history over the longue durée
  • Innumerable studies at regional & local scales

20 of 136

Arrowsmith 1810; Map Exhibiting the Great Post Roads, Physical and Political Divisions of Europe.

Cassini �1750-1815;

Carte de France

ORBIS 2012;

Sea mesh of the Roman World

21 of 136

Challenges

  • Every map, certainly every class of map, has distinctive digitization issues
    • Encoding (given by legend, if there is one)
  • What data, exactly? Purpose-driven use cases
  • Feature type vocabularies?
  • What institutions? Libraries!

22 of 136

Links

Work

Blog

SIG

Twitter

Email

23 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Sue Bigelow, City of Vancouver Archives

24 of 136

25 of 136

26 of 136

27 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Patrick Florance, Tufts University

28 of 136

29 of 136

30 of 136

31 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Merrick Lex Berman, Harvard University

32 of 136

Temporal Gazetteer Web Service

Merrick Lex Berman mberman@fas.harvard.edu

  1. Generic data structure for historical geographic features
  2. Schema for integration of unrelated data sources
  3. API for automated processing of queries
  4. Faceted search engine for human-readable queries
  5. Ruleset for conflation, disambiguation, attestation of relationships
  6. Public schema, codebase, and documentation

Center for Geographic Analysis, Harvard

617-496-9439

33 of 136

TGAZ System – Overview

34 of 136

New API Launched

35 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Petr Pridal, Klokan Technologies GmbH

36 of 136

www.klokantech.com

37 of 136

www.oldmapsonline.org

38 of 136

boundingbox.klokantech.com

39 of 136

www.georeferencer.com

40 of 136

41 of 136

42 of 136

43 of 136

44 of 136

45 of 136

46 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Jon Voss, Shift

47 of 136

48 of 136

49 of 136

50 of 136

51 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Evan Thornberry, Boston Public Library

52 of 136

53 of 136

54 of 136

55 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Mark McGee, Harvard University

56 of 136

57 of 136

58 of 136

59 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Humphrey Southall, University of Portsmouth

60 of 136

Hello, I am Humphrey Southall …

  • Professor of Historical Geography at the University of Portsmouth, UK
  • Creator of Great Britain Historical GIS, and of web site A Vision of Britain through Time
  • Director of Old Maps Online
    • But Petr Pridal is creator of that web site
    • At NYPL in February 2012, organising Working Digitally with Historical Maps as OMO launch
  • Current focus: PastPlace global gazetteer
  • I want to use old maps, and want map librarians to put them on-line for me
    • Only putting them online myself out of desperation

61 of 136

Old maps online are better than paper maps

  • Usable by far more people
    • Few of whom live anywhere near good map libraries
  • Will be used by more people
    • Limited data suggest x10 more visits online than in person
    • Users local and family historians, not cartographic historians
    • Need collections geo-referenced to enable access
  • Easier to use on modern devices
  • Can be cut up and scribbled on … without harm
    • New potentials for engagement

62 of 136

Barriers to old maps online everywhere

  • Lack of funds for digitization projects
    • But is this really the biggest problem?
    • If equipment is permanently on site, use staff free time
  • Library bureaucracy
    • What’s so special about National Library of Scotland?
    • Barriers between map librarians and library web sites
  • Copyright and senses of ownership –letting go?
    • Need to distinguish clearly between original publishers’ copyrights and copyright-like restrictions imposed by libraries
  • Getting credit for online use
    • Librarians becoming invisible as libraries digitize, and consequently seen as redundant
    • Can you get useful usage statistics for “your” web site?

63 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Tim Waters, Topomancy LLC

64 of 136

19th Century Hunterston, Scotland

OpenHistoricalMap.org

start_date

end_date

65 of 136

Combined - all times

2009

2008

Also Historic OSM Data

Roman Mainz

OpenHistoricalMap.org

66 of 136

OSM Stack

Renderd / Mapnik – date range support

Osm2pgsql – lua script to import start_date and end_date

TODO

ID Editor – date filtering / time widget

Dynamic tiles / caching.

Vector tiles

Community

https://github.com/openhistoricalmap/

OSM OHM Mailing List�http://wiki.openstreetmap.org/wiki/Open_Historical_Map

leatherwood.herokuapp.com/

“OSM Way”

Adhoc

Do what works first

start_date / end_date

Imagery / Re:Build

OSM vs GIS

Crowd vs Establishment?

OpenHistoricalMap.org

leatherwood.herokuapp.com

512 buildings

NLS Map London, 19th C

67 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

End - The State of the Art - Part 1

68 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Begin - The State of the Art - Part 2

69 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Tsering Wangyal Shawa, Princeton University

70 of 136

71 of 136

72 of 136

73 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Julie Sweetkind-Singer, Stanford University

74 of 136

Digital Philanthropy and Image Integration

Julie Sweetkind-Singer

November 5, 2014

75 of 136

76 of 136

77 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Jack Reed, Stanford University

78 of 136

Geospatial Discovery and Digital Libraries, Introducing GeoBlacklight

Jack Reed / @mejackreed

79 of 136

GeoHydra

OGC Standards / Web Services

GeoBlacklight

Preservation

Access

Discovery

80 of 136

81 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Jessie Braden, Pratt Institute

82 of 136

Geospatial Professionals in Academia: Harnessing the Collective Brain Power

Anyone know a good air quality sensor for smart phones?

Here’s a great tutorial using D3 to make map graphics.

Another new web mapping tool?!

Has anyone tried a flipped classroom for GIS?

83 of 136

This site/organization should

Focus on geospatial academic support in the following areas:

1. Instruction/teaching

2. Data & information management

3. Computing infrastructure

4. Research

5. New tools development

6. Job/Freelance postings

Not be owned or governed by any one organization or company.

Be inclusive but selective in who can be an editor/contributor.

Start light weight and grow organically.

84 of 136

http://www.hollyorr.com/gpa/

Test site

85 of 136

Join us

Jessie Braden: savi@pratt.edu

Patrick Florance: patrick.florance@tufts.edu

Holly Orr: holly.orr@nyu.edu

86 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Christopher Thatcher, Library of Congress

87 of 136

ETL and Geodata at LC

Chris Thatcher / Digital & Web Initiatives

http://www.loc.gov

88 of 136

100+ Databases & Workflows

One Search

  • Crawl it all, over and over.
  • No responsibility as a repository, just for uniform-ish discovery.

http://en.wikipedia.org/wiki/Extract,_transform,_load

89 of 136

Adding Value

  • Duplicate & Merge
  • Segment
  • Supplement
    • Gazetteer / Topomancy / LC / NYPL

http://loc.gazetteer.us/

90 of 136

Work in Progress

91 of 136

Geographic search and supplements

  • Items near this - supplement
  • Geographic Drill down - browse
  • Search by bounding box - search

92 of 136

ETL and Geodata at LC

Chris Thatcher / Digital & Web Initiatives

http://www.loc.gov

Special thanks to NYPL, Matt Knutzen, and Topomancy.

93 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Kimberly Kowal, British Library

94 of 136

Kimberly C. Kowal, Lead Curator, Digital Mapping

Digital Mapping

at the British Library

Ottermouth Haven [Coasts of Devon and Dorset from Dartmouth to Weymouth with a written description of Ottermouth Haven].  William Cecil, Lord Burghley, 1579. BL Shelfmark: Royal MS. 18. D.III

95 of 136

Ordnance Survey: paper to digital collecting, 1780 to 2014

96 of 136

97 of 136

98 of 136

Pelagios 3: Early Geospatial Documents

99 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Tom MacWright, Mapbox

100 of 136

Change

Time

Solved & Unsolved Problems - Tom MacWright - tmcw

101 of 136

©

Solved & Unsolved Problems - Tom MacWright - tmcw

102 of 136

Standards

Solved & Unsolved Problems - Tom MacWright - tmcw

103 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Stace Maples, Yale University

104 of 136

105 of 136

106 of 136

107 of 136

108 of 136

109 of 136

110 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Michael Sperazza, Stony Brook University

111 of 136

GEOSPATIAL CENTER

112 of 136

MAPPING LONG ISLAND

113 of 136

MAPPING LONG ISLAND

  • HISTORICAL DATA REPOSITORY
  • CREATING DATA FROM HISTORICAL SOURCES
    • MAPS
    • TEXT
    • CENSUS
  • FREE ACCESS
  • WEB SERVICES
  • DATA DOWNLOADABLE
  • PARTNERSHIPS
  • STUDENT INTERNSHIPS / RESEARCH

114 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Salim Mohammed, Stanford University

115 of 136

116 of 136

117 of 136

118 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Wayne Graham, University of Virginia

119 of 136

neatline.org

120 of 136

  • For humanist interpretation, not algorithmic visualization
  • Graphesis
  • Integrates with mapping servers
  • Hand-crafted interactive geotemporal interpretations of collections

121 of 136

122 of 136

123 of 136

124 of 136

125 of 136

126 of 136

127 of 136

neatline.org

128 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Susanna Ånäs, Wikimaps

129 of 136

130 of 136

131 of 136

132 of 136

commons.wikimedia.org/wiki/Commons:Wikimaps

Documentation and features

wikimaps.wikimedia.fi Blog

wikimaps.wikimedia.fi/events Every first Tuesday of the Month

Wikimaps Nordic 16:00

Wikimaps Designers & Developers 18:00 EET/EEST

www.facebook.com/groups/wikimaps/

lists.wikimedia.org/mailman/listinfo/wikimaps

133 of 136

Moving Historical Geodata to the Web

The New York Public Library

Supported by the Alfred P. Sloan Foundation

November 5-7, 2014

Wednesday, November 5th, 2014

Lightning Talks

Ben Lewis, Harvard University

134 of 136

A Training-by-Crowdsourcing Approach for Place Name Extraction from Historical Maps

Yao-Yi Chiang USC, Ben Lewis Harvard

BUDAMA

OCR

Text pattern recognition

Possible lookup input from existing gazetteers.

(georeferenced raster)

Eventual linked data publishing?

135 of 136

Draft System Diagram

136 of 136

Text Example