ABCDEF
1
This is a short list of notable datasets currently missing from the inventories of public sector data held on Data.gov.uk. If you can think of any others please feel free to tweet me @owenboswarva. This list was last updated on 20/01/2017.
2
DatasetDescriptionData HolderDGU StatusInformation LinkNotes
3
Airport Public Safety Zones (PSZs) and Risk ContoursBoundary dataset for Public Safety Zones (PSZs) and 1:10000 Risk Contours in respect of an estimated 32 UK airports, held in DXF format.Department for Transport (DfT) and Civil Aviation Authority (CAA)no recordhttps://www.gov.uk/government/publications/control-of-development-in-airport-public-safety-zonesResponsibility for implementation of new PSZs and the review and update of existing PSZs was transferred to CAA in 2010. However DfT retains overall policy responsibility for PSZs.
4
AIS Derived Shipping Activity GeodatabaseDataset described as "spatial vector vessel transits and a 0.25km2 cell (0.5km by 0.5km grid) resolution shipping density as two separate layers of information for the South Coast Marine Plan Areas."Marine Maritime Organisation (MMO)no recordhttps://data.gov.uk/data-request/ais-derived-shipping-activity-geodatabase-0Production of this dataset is described in a MMO report published in December 2013 (see link).
5
Analysis of Airprox in UK AirspaceData derived from aviation near miss reports.UK Airprox Board i.e. Civil Aviation Authority (CAA)no recordhttps://www.airproxboard.org.uk/Reports-and-analysis/Airprox-reports-2016/Data is available for download from the UK Airprox Board website. Terms previously given as "personal use only" but that statement has been removed so re-use conditions are unclear.
6
Armed Forces CovenantDataset of businesses that have signed the Armed Forces CovenantMinistry of Defenceno recordhttps://www.gov.uk/government/publications/search-for-businesses-who-have-signed-the-armed-forces-covenantAvailable on GOV.UK as an open data Excel workbook.
7
Badger Sett LocationsLocation data for badger setts.Animal Health and Veterinary Laboratories Agency (AHVLA)no recordhttps://www.gov.uk/government/publications/badger-sett-locationsDefra has confirmed in a FOI response that AHVLA holds this data.
8
Birdstrike DatabaseData reported on bird strike occurrences at licensed aerodromes in the UK.Civil Aviation Authority (CAA)no recordhttp://www.caa.co.uk/Commercial-Industry/Airports/Safety/Birdstrikes/
9
Broad Rental Market AreasBoundary dataset for areas by reference to which maximum housing benefit in the private sector is calculated.Valuation Office Agency (VOA) et alno recordhttp://data.gov.uk/data-request/broad-rental-market-areas-postcodeIncomplete on Data.gov.uk. BRMAs are displayed as PDFs on VOA website. BRMAs boundaries for Scotland are on Data.gov.uk (from Scottish Government) and boundaries for England from 2012 are on Data.gov.uk (via Cambridgeshire Insight). Boundaries for England and Wales released as open data following FOI requests from Owen Boswarva: http://www.sharegeo.ac.uk/browse?value=Boswarva%2C+Owen&type=author
10
CAP PaymentsRecords of amounts received by UK beneficiaries under the Common Agricultural Policy (CAP).Department for Environment, Food and Rural Affairs (Defra)no recordhttp://cap-payments.defra.gov.uk/Download.aspxDGU holds records with the withdrawn 2008 and 2009 releases, but not for more recent datasets.
11
Care Providers Registered under the Health and Social Care ActDataset containing locations and details of care providers regulated by the CQC.Care Quality Commissionno recordhttp://www.cqc.org.uk/content/how-get-and-re-use-cqc-information-and-dataThis dataset is reusable under the Open Government Licence, i.e. is open data.
12
Casework database for commons and greensDataset of past decisions on commons and greens by date, the areas affected and which Act was used to grant the changes.Department for Environment, Food and Rural Affairs (Defra)no recordhttps://www.gov.uk/government/publications/commons-and-greens-casework-databaseOn GOV.UK and reusable under the Open Government Licence.
13
County Court Judgments (CCJ)Bulk data on money judgments made by county courts in England and Wales.Ministry of Justice (MOJ)no recordhttp://www.trustonline.org.uk/understand-judgments-fines/entries-on-the-england-and-wales-register/ccjs-and-the-registerMaintained by Registry Trust on behalf of MOJ. Available under licence on commercial terms.
14
Courts and TribunalsDataset of courts and tribunals (including probate offices) in England and Wales, including address locations, opening times and other information.Ministry of Justice (MOJ)no recordhttps://courttribunalfinder.service.gov.uk/This is the dataset underlying the "court finder" application on the GOV.UK website.
15
Enforcement DatabasesSuite of databases that support HSE's public registers of enforcement notices and convictions.Health and Safety Executive (HSE)no recordhttp://www.hse.gov.uk/notices/default.aspIncludes database of enforcement notices, notice history and prosecutions.
16
E-petitions (old)Counts and location data for responses to petitions on the Government's E-petitions website.Cabinet Officeno recordhttp://epetitions.direct.gov.uk/faqE-petitions service is now defunct as there is a service on the UK Parliament site. However data at postcode sector district level was available via an (obscure) API, so Cabinet Office presumably still holds the historic bulk data.
17
Flood Risk ObjectionsList of objections to major developments in England and Wales made on flood risk grounds.Environment Agencyno recordhttps://www.gov.uk/government/publications/environment-agency-objections-to-planning-on-the-basis-of-flood-riskMonthly lists no longer published but EA has resumed publication of an annual list.
18
Flood Warnings DirectData on households registered to receive flood warning notifications. Flood Warning Areas define locations within the Flood Warning Service Limit that represent a discrete community at risk of flooding.Environment Agencyno recordhttps://fwd.environment-agency.gov.uk/app/olr/registerEA has said it considers household-level data to be personal data, but there may be an argument for release of non-disclosive statistics.
19
Internal Drainage Board (IDB) BoundariesGIS data on Internal Drainage Board (IDB) boundaries.Department for Environment, Food and Rural Affairs (Defra)no recordhttp://www.ada.org.uk/wp-content/uploads/2017/02/IDBwallchart2016.pdfA wallchart and other references confirm the dataset exists.
20
Local Authority Housing AssetsData collected from English councils in 2015.Department for Communities and Local Government (DCLG)no recordhttp://mapgubbins.tumblr.com/post/147192152825/dclg-should-release-the-local-authority-housing
21
Marker PostsLocation data for marker posts placed at 100m intervals on motorways and trunk roads.Highways Agencyno recordhttp://data.gov.uk/data-request/highways-agency-marker-post-id-locations-and-emergency-telephone-locationsHighways Agency has confirmed in a FOI response that it holds this data.
22
Noise Exposure Contours Around London AirportsContour data for noise exposure measured around London-area airports, published annually as vector data in DXF format. Department for Transport (DfT)no recordhttps://www.gov.uk/government/publications/noise-exposure-contours-around-london-airportsData is available for download from the Department for Transport website, and is apparently open data.
23
RAIB Immediate Cause and Causal Factors DatabaseDatabase containing classifications of immediate cause and other causal factors that led to railway accidents or incident.Rail Accident Investigation Branch (RAIB)no recordhttp://raib.gov.uk/publications/immediate_cause_and_causal_factors_database.cfmThis database may be viewed on the RAIB website but is not available for bulk download.
24
Register of CharitiesOfficial register of key facts and figures about the work and finances of charitable organisations in England and Wales.Charity Commissionno recordhttp://data.charitycommission.gov.uk/Commitment to open release by March 2014 was announced by Cabinet Office in June 2013. Bulk data from December 2014 is now available (in a non-open format).
25
Register of Data ControllersOfficial register of organisations and people registered with the ICO under the Data Protection Act.Information Commissioner's Office (ICO)no recordhttps://ico.org.uk/about-the-ico/what-we-do/register-of-data-controllers/download-the-registerRe-usable under the OGL but may contain personal data.
26
Risk Protection Arrangement (RPA) MembersList of academy trusts that are members of DfE's Risk Protection Arrangement (RPA).Department for Educationno recordhttps://www.gov.uk/academies-risk-protection-arrangement-rpaReleased previously in response to FOI requests (private correspondence).
27
Trig ArchiveLegacy database of locations of OS triangulation pillars.Ordnance Surveyno recordhttps://www.ordnancesurvey.co.uk/gps/legacy-control-information/triangulation-stationsPublished on the OS website following a 2015 FOI request. Now re-usable as OGL open data.
28
UK Plant Health Risk RegisterRegister of pests that present a concern to plant health.Fera Science Limited (FSL), a joint venture between Defra and Capitano recordhttps://secure.fera.defra.gov.uk/phiw/riskRegister/Searchable online and re-usable under the OGL.
29
UK Radioactive Waste InventoryThis dataset is the latest national record on radioactive wastes and materials in the UK, updated every three years.Nuclear Decommissioning Authority (NDA)no recordhttp://www.nda.gov.uk/ukinventory/NDA maintains a website based on the inventory data, but there is no bulk download functionality.
30
Value for Money (VFM) ProfilesData supplied by councils and fire and rescue authorities, maintained by Audit Commission to support auditors' work.Audit Commission (now defunct)no recordhttp://webarchive.nationalarchives.gov.uk/20150211161507/http://vfm.audit-commission.gov.uk/No longer accessible online now that Audit Commission has been closed, as National Archives does not support the report functionality.
31
Vehicle fuel consumption and emissions dataFuel consumption and emissions data for different types of car and van, including historical.Vehicle Certification Agency (VCA)no recordhttp://carfueldata.direct.gov.uk/ and http://vanfueldata.dft.gov.uk/The only reference on DGU is a record describing the data incorrectly as "unpublished": https://data.gov.uk/dataset/passenger-car-and-van-fuel-consumption-data
32
VMD Product Information DatabaseDetails of all veterinary medicinal products currently authorised in the UK together with a list of suspended and recently expired products.Veterinary Medicines Directorate (VMD)no recordhttps://www.vmd.defra.gov.uk/ProductInformationDatabase/Available for download from VMD website. Link on the landing page indicates the dataset is covered by the Open Government Licence, i.e. is open data.
33
34
35
36
The following datasets were previously listed above as missing from Data.gov.uk, but have now been added to the inventories:
37
DatasetDescriptionData HolderDGU StatusData.gov.uk LinkNotes
38
CCG MapsBoundary dataset for Clinical Commissioning Group (CCG) areas in England.NHS Englandnow addedhttp://data.gov.uk/dataset/ccg-mapOpen data available for download from NHS England website.
39
EduBaseRegister of schools and other educational establishments in England and Wales.Department for Education (DFE)now addedhttp://data.gov.uk/dataset/schools-in-englandNot ideal, but discoverable via the Schools in England entry.
40
Flood Warning Areas (AfA054)Spatial datasets describing geographical areas where the Environment Agency expects flooding to occur and where the Environment Agency provides a Flood Warning Service.Environment Agencynow addedhttp://data.gov.uk/dataset/flood-warning-areasReleased as open data from February 2014.
41
Green BeltBoundary dataset for Green Belt areas in England.Department for Communities and Local Government (DCLG)now addedhttp://data.gov.uk/dataset/designated-green-belt-boundary-for-englandThe DCLG boundary dataset, compiled from local government sources, is in circulation but not licensed for re-use.
42
Places of WorshipRegister of places of worship in England and Wales.General Register Office (GRO)now addedhttp://data.gov.uk/dataset/places-of-worshipMaintained by GRO in compliance with the Places of Worship Registration Act 1855.
43
Rural Land RegisterDetails of all registered land parcels, held as part of administration of Common Agricultural Policy (CAP) schemes.Rural Payments Agency (RPA)now addedhttp://data.gov.uk/dataset/rural-land-registerDefra has said informally that this dataset will be recorded on DGU shortly.
44
Noise Maps of EnglandNoise maps produced by Defra to meet the requirements of the Environmental Noise (England) Regulations 2006.Department for Environment, Food and Rural Affairs (Defra)now addedhttps://data.gov.uk/data/search?q=noise&publisher=department-for-environment-food-and-rural-affairsDatasets released as open data in August 2015.
45
46
47
The following datasets were previously listed above as missing from Data.gov.uk, but are now out of scope because the data holder has been privatised:
48
DatasetDescriptionData HolderDGU StatusData.gov.uk LinkNotes
49
Postbox DataData on postbox locations and collection times.Royal Mailno recordhttp://data.gov.uk/data-requests/post-boxesData is held in Royal Mail's Central Collections Management Database and Final Plate Database. It was previously released in response to FOI requests, but that avenue has closed now that Royal Mail is in private hands.
50
Postcode Address File (PAF)Database of all UK postal delivery addresses and postcodes.Royal Mailno recordhttp://www.poweredbypaf.com/end-user/products/data-products/paf-raw-data/Cabinet Office has indicated there is no plan to record this data on DGU.
51
52
53
54
55