1 of 61

GeoServer

Orientation

FOSS4GUK

ONLINE 2020

2 of 61

Introductions

Jody Garnett

Technical Director

jody.garnett@gmail.com

@jodygarnett

GeoCat

Netherlands open-source company focused on spatial data publication and discovery.

Open Source Projects

  • GeoServer, GeoTools, JTS, ImageN, uDig

Open Source Geospatial Foundation

  • Incubation Committee Chair
  • GeoTools Project Officer
  • Marketing Committee Co-chair�

Eclipse Foundation

  • Technology Project Chair

3 of 61

Popular GeoServer Talks

GeoServer use in organizations, and technologies, around the worlds.

Beloved features, and impressive tricks, showing what is possible with GeoServer

Annual team update and tour of what is new!

4 of 61

Popular GeoServer Talks: Updated!

GeoServer use in organizations, and technologies, around the worlds.

Beloved features, and impressive tricks, showing what is possible with GeoServer

Annual team update and tour of what is new!

Downloaded GeoServer, now what does it do again?

5 of 61

What is GeoServer for?

6 of 61

GeoServer Vision

geoserver.org:

“GeoServer is an open source server for sharing geospatial data.”

GeoServer is passionate about sharing data. GeoServer was founded out of a community project to map trees in New York city.

  • If you are here to share a map..�GeoServer can do mapping
  • But we don’t stop at a map ...�GeoServer will share the data
  • And don’t stop at the data …�GeoServer encourages data editing

7 of 61

GeoServer approach

Approach:

Designed for interoperability, it publishes data from any major spatial data source using open standards.

GeoServer really does not want to “lock-in” in you or your data, from the ground up:

  • Access your data where it is stored
  • An share your data with a wide audience
  • We start with “industry standards”
  • Add more protocols over time

Opposite of a “not-invented-here” attitude.

If GeoServer has to invent something in isolation chances are we are doing it wrong.

8 of 61

Map Publishing

GeoServer can publish maps:

  • Each dataset is a “layer” of content
  • Gather into a “layer group”�to arrange layers into a basemap
  • Aside: We include a small layer preview (intended for local testing)

GeoServer is the rendering engine producing maps, for access from web clients and desktop clients.

9 of 61

Map Publishing: Continued

GeoServer map publishing is about publishing a visualization.

More than one approach:

  • Publish as a “Map” supporting, ad-hoc requests to draw imagery
  • Publish entire “Tileset” of content

The result does not always look like an image:

  • SVG and KML output combine vector output with styling
  • Extensions provide PDF output for printing
  • Vector-tile output pre-processed for client side drawing

10 of 61

Vector data: publishing

In the spirit of open, GeoServer is setup to share the data being used to draw the map.

To reach a wide audience:

  • Supports queries
  • Range of output formats available�(and more available to install)

11 of 61

Vector data: editing

Sharing does not stop at providing access, the ability to edit information together is key to collaboration.

GeoServer is not used to interactively edit data, instead it provides a protocol for QGIS Desktop and OpenLayers library to edit information. These clients are responsible for providing an interactive editing experience.

The same protocols can be used in your own scripts for batch editing and processing.

Hint: We made sure editing is off by default!

12 of 61

Raster data access

Direct access to raster data is available.

  • Imagery
  • Digital Elevation Model
  • NetCDF for scientific modeling

Hint: The language “grid coverage” is used to emphasis that measurements are being provided (rather than just a visualization)

13 of 61

How do I use it?

14 of 61

GeoServer Configuration

GeoServer provides a web application for configuration and setup.

A REST API is also available for automation.

Notes:

  • “Web admin” is not really geoserver
    • Only used for setup geoserver
    • In production hide this!
  • The links to “service capabilities” are the actual web services

15 of 61

Natural Earth

A great public domain dataset used for web illustrations.

Our example uses the “Quickstart” download containing a range of vector and raster data

See: www.naturalearthdata.com

16 of 61

Workspace

17 of 61

Workspace

Workspace is used to:

  • Folder to organize content
  • “Namespace” for XML content publication

Notes:

  • Workspace name used as a prefix for each layer
  • Namespace should be a unique URI
  • One workspace can be the “default”
  • Advanced: Each workspace can be used as its own “virtual web service”

18 of 61

New Workspace

  • Data → Workspaces
  • Create new workspace
  • Fill in:
    • Name: ne
    • Namespace: http://ne
  • Mark as default workspace�

19 of 61

Data Source

20 of 61

Vector Data Source

Data store:

  • Used to connect to your data
    • Shapefile needs a file location
    • Database needs connection parameters
  • Managed in a workspace

Notes:

  • DataStore name is “internal” to GeoServer
    • So you can switch from Oracle to PostGIS
  • Called a “DataStore” as we were focused on editing (and thus storing information)

21 of 61

New Vector Data Source

  • Data → Stores
  • Add new store
  • Select Directory of spatial files (shapefiles)
  • Name: Culture
  • Connection Parameters
    • Use browse button to locate�Natural Earth 4.1.1/10m_cultural
  • Save

22 of 61

Add Raster Data Source

  • Data → Stores
  • Add new store
  • Select Directory of spatial files (shapefiles)
  • Name: NE
  • Connection Parameters
    • Browser to locate NE1_50M_SR_W/NE1_50M_SR_W.tif
  • Save

23 of 61

Layer

24 of 61

Layers

Layer:

  • GeoServer publishes information as distinct layers
  • To publish you need to check
    • Name and title for the layer
    • Spatial Reference System
    • Bounds

Notes:

  • Each protocol uses a different word for its data product (feature type, coverage, tileset)

25 of 61

New Vector Layer

  • Data → Layers
  • Use add new layer, and select ne:Culture
  • Ne_10m_admin_1_states_provinces_shp

26 of 61

New Vector Layer: Description

  • Data → Layers
  • Use add new layer, and select ne:Culture
  • Ne_10m_admin_1_states_provinces_shp
  • Data
    • Name: states_provinces_shp
    • Title: States and Provinces

27 of 61

New Vector Layer: Bounds

  • Data → Layers
  • Use add new layer, and select ne:Culture
  • Ne_10m_admin_1_states_provinces_shp
  • Data
    • Name: states_provinces_shp
    • Title: States and Provinces
  • Spatial Reference System:�EPSG:4326
  • Native bounding box:�Click compute from data
  • Lat/Lon Bounds:
  • Click compute from native bounds
  • Save

28 of 61

New Vector Layer: Preview

  • Data → Layer Preview
  • Locate ne:states_provinces_shp in list
  • Click OpenLayers to open preview app

29 of 61

New Raster Layer

  • Data → Layers
  • Use add new layer, select “NE1_50M_SR_W
  • Data
    • Name: “ne
    • Title: “Natural Earth I
  • Double check:
    • Spatial Reference System
    • Bounds
  • Save

30 of 61

New Raster Layer: Preview

  • Data → Layer Preview
  • Locate ne:ne1 in list
  • Click OpenLayers to open preview app

31 of 61

Layer Group

32 of 61

Layer Group

Layer groups are used:

  • Can be used as a basemap
  • Order of layers is in draw order

Notes:

  • Can also use layer groups to define a table-of-contents structure for published content

33 of 61

Create Layer Group

  • Data → Layer Group
  • Click Add new layer group
  • Details:
    • Name: basemap
    • Title: Basemap

34 of 61

Create Layer Group

  • Data → Layer Group
  • Click Add new layer group
  • Details:
    • Name: basemap
    • Title: Basemap
  • Scroll down to Layers heading
  • Use add layer to add�ne:ne1
  • Use add layer to add ne:state_province_shp
  • Scroll up to bounds
  • Click Generate Bounds
  • Save

35 of 61

Create Layer Group: Preview

  • Data → Layer Preview
  • Locate ne:basemap in list
  • Click OpenLayers to open preview app

36 of 61

Style

37 of 61

Style

Used to configure the rendering process:

  • We use an XML format called SLD
    • Intended for machine-to-machine use!
  • We recommend people use CSS or YSLD

Notes:

  • Built-in styles provided
  • Styles folder used for icons and fonts
  • Each workspace has a styles folder also

38 of 61

New Style

  • Data → Styles
  • Click Add new style
    • Workspace: ne
    • Name: mapcolor9
    • Format: YSLD
  • Select Polygon, and Generate

39 of 61

New Style: Live Preview

  • Data → Styles
  • Click Add new style
    • Workspace: ne
    • Name: mapcolor9
    • Format: YSLD
  • Select Polygon, and Generate
  • Apply, and then Layer Preview tab

40 of 61

New Style: Theme

  • Data → Styles
  • Click Add new style
    • Workspace: ne
    • Name: mapcolor9
    • Format: YSLD
  • Select Polygon, and Generate
  • Apply, and then Layer Preview tab
  • Fill in style shown, and Apply

symbolizers:

- polygon:

stroke-color: 'gray'

stroke-width: 0.5

fill-color: ${Recode(mapcolor9,

'1','#8dd3c7',

'2','#ffffb3',

'3','#bebada',

'4','#fb8072',

'5','#80b1d3',

'6','#fdb462',

'7','#b3de69',

'8','#fccde5',

'9','#d9d9d9')}

Theme from user guide style workshop

41 of 61

New Style: Theme

  • Data → Styles
  • Click Add new style
    • Workspace: ne
    • Name: mapcolor9
    • Format: YSLD
  • Select Polygon, and Generate
  • Apply, and then Layer Preview tab
  • Fill in style shown, and Apply�(Theme on “mapcolor9” attribute)

42 of 61

New Style: Publishing

  • Data → Styles
  • Click Add new style
    • Workspace: ne
    • Name: mapcolor9
    • Format: YSLD
  • Select Polygon, and Generate
  • Apply, and then Layer Preview tab
  • Fill in style shown, and Apply�(Theme on “mapcolor9” attribute)
  • Use Publishing tab, set default for ne:state_provinces_shp

43 of 61

New Style: Layer Preview

  • Data → Layer Preview
  • Locate ne:states_provinces_shp in list
  • Click OpenLayers to open preview app

44 of 61

New Style: Layer Group Preview

Layer Group:

  • Data → Layer Group
  • Edit ne:basemap
  • Update layers to use the default style checkbox for ne:states_provinces_shp

Layer Preview:

  • Data → Layer Preview
  • Locate ne:basemap in list
  • Click OpenLayers to open preview app

45 of 61

How does it work?

46 of 61

GeoServer

Wicket

GeoTools

geowebcache

Web Administration

BlobStore

OpenLayers

core

Catalog

application server

Jetty

Spring

JAI

Spring MVC

REST-API

Data Directory

Resource Pool

WMS

Dispatcher

WFS

WCS

TMS

WMTS

GeoWebCache

Java Runtime Environment

OpenJDK

wms

wfs

wcs

47 of 61

GeoServer Internals

  • Java Web Application
    • Spring Framework - powerful framework for wiring together application out of components
    • Apache Wicket User Interface - framework only a java developer could love
  • Modular Architecture
    • Enables the community to build extensions�(a key success factor for open source projects)
  • GeoTools Library
    • Handles the data access, reprojection, and rendering
    • Try and keep GeoServer “light” and focused on sharing by moving heavy lifting here
  • Java Advanced Imaging (and JAI-ExT)
    • Image processing library offering on-demand processing model
    • JAI-EXT teaching the image processing engine new tricks (“no-data”, “foot-prints”, …)

48 of 61

Doing more

49 of 61

Extensions

We saw a lot of effort devoted to keeping GeoServer modular.

  • Official GeoServer plugins are called extensions
  • Extensions are formally “part of GeoServer”
    • Must meet the same quality assurance and documentation requirements as core
    • Included in the release process, they version numbers match!

50 of 61

Check out some extensions

  • Oracle DataStore
    • Is Oracle required for your data management policies? You can still use open standards.
  • WPS Extension
    • Providing an entirely new services, in this case one used for processing and analysis
  • GeoMesa
    • Cloud database are supported also!
    • GeoMesa offers both a DataStore for data access, and also WPS Processes to better summarize and work with massive cloud data volumes
  • GeoFence
    • Integrates “GeoFence” security model, for “edit permission” with a specific operating area
  • Vector Tiles
    • Generate pre-processed tiles of vector content ready for client-side rendering

51 of 61

Community Modules (for RnD)

Community modules started as a way to help developers share RnD ideas.

  • Very helpful when working with grad students
  • Also used by consulting teams take on specific challenges for their customers
  • Ideally we want these to attract funding and become extensions

These are very much “use at your own risk”:

  • These are not released as part of GeoServer
  • You are expected to compile these yourself
  • Not subject to any quality assurance or IP check

52 of 61

Check out some community modules

  • JDBC Config / JDBC Store
    • Replace the entire catalog (config) and data directory (store)
    • Use with AWS to “carefully” manage a cloud cluster
  • Backup and Restore
    • Transport configuration settings from test to production
  • SOLR datastore
  • Dynamic colormap generation
  • MapML
  • SAP Hana
  • OGC API Features

53 of 61

Brought to you by

54 of 61

Project Steering Committee

GeoServer is setup as an “Open Source Geospatial Foundation” project. With a core “project steering committee” and notes on how to keep everything running in a fair and consistent manner.

Steering committee members vote on change proposals, that come from a wide range of organizations participating in RND.

We try and have a mix of skills, with developers, users, managers, and designer joining the team as required to help out.

PSC Members:

  • Alessio Fabiani
  • Andrea Aime
  • Ian Turton
  • Jody Garnett
  • Jukka Rahkonen
  • Kevin Smith
  • Nuno Oliveira
  • Simone Giannecchini
  • Torben Barsballe

55 of 61

Strong history of collaboration

Being “vendor-neutral” has allowed GeoServer to weather the success and failures of participating organizations.

In addition to an open source license we make use of the OSGeo Contributor License agreement to help in this respect.

This also has allowed the PSC to contribute code “up-stream” to more permissive projects.

Collaboration happens at the personal level, and also across organizations.

The OpenPlannng Project started GeoServer to support community mapping activities. Early collaborations with GeoSolutions, Refractions Research helped establish procedures to make this an open project.

GeoServer supports an active RnD scene with research labs, consulting companies and others joining to add new features.

56 of 61

Try it out!

57 of 61

Running GeoServer

Options:

  • “binary” download used to try things out on the command line, often for testing or evaluation
  • “Web Archive” for use with your application server (we recommend Tomcat)
  • Sorry no Windows or macOS installers at present, due to vandalism

Alternatives:

  • Docker? Nothing official, everyone is making their own …
  • Hosted? A few companies offer hosting

58 of 61

Running GeoServer

59 of 61

Thanks

Questions welcome!

60 of 61

Mini production check-list

  • Please change the default�user name and password
  • Also change the master password�(used to encrypt on disk)
  • Update contact information�(See “Claudius Ptolomaeus”)

GeoServer 1.0

GeoServer 2.16.2

61 of 61

GeoServer at a Glance

Java Web Application to share and edit geospatial data.

Publish data from any major spatial data source using open standards.

Core Protocols

WMS – maps�WFS – vector �WFS-T – editing �WCS – coverage�WMTS – tiles�TMS – tiles�WMS-C – tiles

Extension/community protocols�WPS – process�CSW – search�OpenSearch for Earth Observation – search�OGC API - prototype json + rest standards