A | B | C | D | E | F | |
---|---|---|---|---|---|---|
1 | This is a short list of notable datasets currently missing from the inventories of public sector data held on Data.gov.uk. If you can think of any others please feel free to tweet me @owenboswarva. This list was last updated on 20/01/2017. | |||||
2 | Dataset | Description | Data Holder | DGU Status | Information Link | Notes |
3 | Airport Public Safety Zones (PSZs) and Risk Contours | Boundary dataset for Public Safety Zones (PSZs) and 1:10000 Risk Contours in respect of an estimated 32 UK airports, held in DXF format. | Department for Transport (DfT) and Civil Aviation Authority (CAA) | no record | https://www.gov.uk/government/publications/control-of-development-in-airport-public-safety-zones | Responsibility for implementation of new PSZs and the review and update of existing PSZs was transferred to CAA in 2010. However DfT retains overall policy responsibility for PSZs. |
4 | AIS Derived Shipping Activity Geodatabase | Dataset described as "spatial vector vessel transits and a 0.25km2 cell (0.5km by 0.5km grid) resolution shipping density as two separate layers of information for the South Coast Marine Plan Areas." | Marine Maritime Organisation (MMO) | no record | https://data.gov.uk/data-request/ais-derived-shipping-activity-geodatabase-0 | Production of this dataset is described in a MMO report published in December 2013 (see link). |
5 | Analysis of Airprox in UK Airspace | Data derived from aviation near miss reports. | UK Airprox Board i.e. Civil Aviation Authority (CAA) | no record | https://www.airproxboard.org.uk/Reports-and-analysis/Airprox-reports-2016/ | Data is available for download from the UK Airprox Board website. Terms previously given as "personal use only" but that statement has been removed so re-use conditions are unclear. |
6 | Armed Forces Covenant | Dataset of businesses that have signed the Armed Forces Covenant | Ministry of Defence | no record | https://www.gov.uk/government/publications/search-for-businesses-who-have-signed-the-armed-forces-covenant | Available on GOV.UK as an open data Excel workbook. |
7 | Badger Sett Locations | Location data for badger setts. | Animal Health and Veterinary Laboratories Agency (AHVLA) | no record | https://www.gov.uk/government/publications/badger-sett-locations | Defra has confirmed in a FOI response that AHVLA holds this data. |
8 | Birdstrike Database | Data reported on bird strike occurrences at licensed aerodromes in the UK. | Civil Aviation Authority (CAA) | no record | http://www.caa.co.uk/Commercial-Industry/Airports/Safety/Birdstrikes/ | |
9 | Broad Rental Market Areas | Boundary dataset for areas by reference to which maximum housing benefit in the private sector is calculated. | Valuation Office Agency (VOA) et al | no record | http://data.gov.uk/data-request/broad-rental-market-areas-postcode | Incomplete on Data.gov.uk. BRMAs are displayed as PDFs on VOA website. BRMAs boundaries for Scotland are on Data.gov.uk (from Scottish Government) and boundaries for England from 2012 are on Data.gov.uk (via Cambridgeshire Insight). Boundaries for England and Wales released as open data following FOI requests from Owen Boswarva: http://www.sharegeo.ac.uk/browse?value=Boswarva%2C+Owen&type=author |
10 | CAP Payments | Records of amounts received by UK beneficiaries under the Common Agricultural Policy (CAP). | Department for Environment, Food and Rural Affairs (Defra) | no record | http://cap-payments.defra.gov.uk/Download.aspx | DGU holds records with the withdrawn 2008 and 2009 releases, but not for more recent datasets. |
11 | Care Providers Registered under the Health and Social Care Act | Dataset containing locations and details of care providers regulated by the CQC. | Care Quality Commission | no record | http://www.cqc.org.uk/content/how-get-and-re-use-cqc-information-and-data | This dataset is reusable under the Open Government Licence, i.e. is open data. |
12 | Casework database for commons and greens | Dataset of past decisions on commons and greens by date, the areas affected and which Act was used to grant the changes. | Department for Environment, Food and Rural Affairs (Defra) | no record | https://www.gov.uk/government/publications/commons-and-greens-casework-database | On GOV.UK and reusable under the Open Government Licence. |
13 | County Court Judgments (CCJ) | Bulk data on money judgments made by county courts in England and Wales. | Ministry of Justice (MOJ) | no record | http://www.trustonline.org.uk/understand-judgments-fines/entries-on-the-england-and-wales-register/ccjs-and-the-register | Maintained by Registry Trust on behalf of MOJ. Available under licence on commercial terms. |
14 | Courts and Tribunals | Dataset of courts and tribunals (including probate offices) in England and Wales, including address locations, opening times and other information. | Ministry of Justice (MOJ) | no record | https://courttribunalfinder.service.gov.uk/ | This is the dataset underlying the "court finder" application on the GOV.UK website. |
15 | Enforcement Databases | Suite of databases that support HSE's public registers of enforcement notices and convictions. | Health and Safety Executive (HSE) | no record | http://www.hse.gov.uk/notices/default.asp | Includes database of enforcement notices, notice history and prosecutions. |
16 | E-petitions (old) | Counts and location data for responses to petitions on the Government's E-petitions website. | Cabinet Office | no record | http://epetitions.direct.gov.uk/faq | E-petitions service is now defunct as there is a service on the UK Parliament site. However data at postcode sector district level was available via an (obscure) API, so Cabinet Office presumably still holds the historic bulk data. |
17 | Flood Risk Objections | List of objections to major developments in England and Wales made on flood risk grounds. | Environment Agency | no record | https://www.gov.uk/government/publications/environment-agency-objections-to-planning-on-the-basis-of-flood-risk | Monthly lists no longer published but EA has resumed publication of an annual list. |
18 | Flood Warnings Direct | Data on households registered to receive flood warning notifications. Flood Warning Areas define locations within the Flood Warning Service Limit that represent a discrete community at risk of flooding. | Environment Agency | no record | https://fwd.environment-agency.gov.uk/app/olr/register | EA has said it considers household-level data to be personal data, but there may be an argument for release of non-disclosive statistics. |
19 | Internal Drainage Board (IDB) Boundaries | GIS data on Internal Drainage Board (IDB) boundaries. | Department for Environment, Food and Rural Affairs (Defra) | no record | http://www.ada.org.uk/wp-content/uploads/2017/02/IDBwallchart2016.pdf | A wallchart and other references confirm the dataset exists. |
20 | Local Authority Housing Assets | Data collected from English councils in 2015. | Department for Communities and Local Government (DCLG) | no record | http://mapgubbins.tumblr.com/post/147192152825/dclg-should-release-the-local-authority-housing | |
21 | Marker Posts | Location data for marker posts placed at 100m intervals on motorways and trunk roads. | Highways Agency | no record | http://data.gov.uk/data-request/highways-agency-marker-post-id-locations-and-emergency-telephone-locations | Highways Agency has confirmed in a FOI response that it holds this data. |
22 | Noise Exposure Contours Around London Airports | Contour data for noise exposure measured around London-area airports, published annually as vector data in DXF format. | Department for Transport (DfT) | no record | https://www.gov.uk/government/publications/noise-exposure-contours-around-london-airports | Data is available for download from the Department for Transport website, and is apparently open data. |
23 | RAIB Immediate Cause and Causal Factors Database | Database containing classifications of immediate cause and other causal factors that led to railway accidents or incident. | Rail Accident Investigation Branch (RAIB) | no record | http://raib.gov.uk/publications/immediate_cause_and_causal_factors_database.cfm | This database may be viewed on the RAIB website but is not available for bulk download. |
24 | Register of Charities | Official register of key facts and figures about the work and finances of charitable organisations in England and Wales. | Charity Commission | no record | http://data.charitycommission.gov.uk/ | Commitment to open release by March 2014 was announced by Cabinet Office in June 2013. Bulk data from December 2014 is now available (in a non-open format). |
25 | Register of Data Controllers | Official register of organisations and people registered with the ICO under the Data Protection Act. | Information Commissioner's Office (ICO) | no record | https://ico.org.uk/about-the-ico/what-we-do/register-of-data-controllers/download-the-register | Re-usable under the OGL but may contain personal data. |
26 | Risk Protection Arrangement (RPA) Members | List of academy trusts that are members of DfE's Risk Protection Arrangement (RPA). | Department for Education | no record | https://www.gov.uk/academies-risk-protection-arrangement-rpa | Released previously in response to FOI requests (private correspondence). |
27 | Trig Archive | Legacy database of locations of OS triangulation pillars. | Ordnance Survey | no record | https://www.ordnancesurvey.co.uk/gps/legacy-control-information/triangulation-stations | Published on the OS website following a 2015 FOI request. Now re-usable as OGL open data. |
28 | UK Plant Health Risk Register | Register of pests that present a concern to plant health. | Fera Science Limited (FSL), a joint venture between Defra and Capita | no record | https://secure.fera.defra.gov.uk/phiw/riskRegister/ | Searchable online and re-usable under the OGL. |
29 | UK Radioactive Waste Inventory | This dataset is the latest national record on radioactive wastes and materials in the UK, updated every three years. | Nuclear Decommissioning Authority (NDA) | no record | http://www.nda.gov.uk/ukinventory/ | NDA maintains a website based on the inventory data, but there is no bulk download functionality. |
30 | Value for Money (VFM) Profiles | Data supplied by councils and fire and rescue authorities, maintained by Audit Commission to support auditors' work. | Audit Commission (now defunct) | no record | http://webarchive.nationalarchives.gov.uk/20150211161507/http://vfm.audit-commission.gov.uk/ | No longer accessible online now that Audit Commission has been closed, as National Archives does not support the report functionality. |
31 | Vehicle fuel consumption and emissions data | Fuel consumption and emissions data for different types of car and van, including historical. | Vehicle Certification Agency (VCA) | no record | http://carfueldata.direct.gov.uk/ and http://vanfueldata.dft.gov.uk/ | The only reference on DGU is a record describing the data incorrectly as "unpublished": https://data.gov.uk/dataset/passenger-car-and-van-fuel-consumption-data |
32 | VMD Product Information Database | Details of all veterinary medicinal products currently authorised in the UK together with a list of suspended and recently expired products. | Veterinary Medicines Directorate (VMD) | no record | https://www.vmd.defra.gov.uk/ProductInformationDatabase/ | Available for download from VMD website. Link on the landing page indicates the dataset is covered by the Open Government Licence, i.e. is open data. |
33 | ||||||
34 | ||||||
35 | ||||||
36 | The following datasets were previously listed above as missing from Data.gov.uk, but have now been added to the inventories: | |||||
37 | Dataset | Description | Data Holder | DGU Status | Data.gov.uk Link | Notes |
38 | CCG Maps | Boundary dataset for Clinical Commissioning Group (CCG) areas in England. | NHS England | now added | http://data.gov.uk/dataset/ccg-map | Open data available for download from NHS England website. |
39 | EduBase | Register of schools and other educational establishments in England and Wales. | Department for Education (DFE) | now added | http://data.gov.uk/dataset/schools-in-england | Not ideal, but discoverable via the Schools in England entry. |
40 | Flood Warning Areas (AfA054) | Spatial datasets describing geographical areas where the Environment Agency expects flooding to occur and where the Environment Agency provides a Flood Warning Service. | Environment Agency | now added | http://data.gov.uk/dataset/flood-warning-areas | Released as open data from February 2014. |
41 | Green Belt | Boundary dataset for Green Belt areas in England. | Department for Communities and Local Government (DCLG) | now added | http://data.gov.uk/dataset/designated-green-belt-boundary-for-england | The DCLG boundary dataset, compiled from local government sources, is in circulation but not licensed for re-use. |
42 | Places of Worship | Register of places of worship in England and Wales. | General Register Office (GRO) | now added | http://data.gov.uk/dataset/places-of-worship | Maintained by GRO in compliance with the Places of Worship Registration Act 1855. |
43 | Rural Land Register | Details of all registered land parcels, held as part of administration of Common Agricultural Policy (CAP) schemes. | Rural Payments Agency (RPA) | now added | http://data.gov.uk/dataset/rural-land-register | Defra has said informally that this dataset will be recorded on DGU shortly. |
44 | Noise Maps of England | Noise maps produced by Defra to meet the requirements of the Environmental Noise (England) Regulations 2006. | Department for Environment, Food and Rural Affairs (Defra) | now added | https://data.gov.uk/data/search?q=noise&publisher=department-for-environment-food-and-rural-affairs | Datasets released as open data in August 2015. |
45 | ||||||
46 | ||||||
47 | The following datasets were previously listed above as missing from Data.gov.uk, but are now out of scope because the data holder has been privatised: | |||||
48 | Dataset | Description | Data Holder | DGU Status | Data.gov.uk Link | Notes |
49 | Postbox Data | Data on postbox locations and collection times. | Royal Mail | no record | http://data.gov.uk/data-requests/post-boxes | Data is held in Royal Mail's Central Collections Management Database and Final Plate Database. It was previously released in response to FOI requests, but that avenue has closed now that Royal Mail is in private hands. |
50 | Postcode Address File (PAF) | Database of all UK postal delivery addresses and postcodes. | Royal Mail | no record | http://www.poweredbypaf.com/end-user/products/data-products/paf-raw-data/ | Cabinet Office has indicated there is no plan to record this data on DGU. |
51 | ||||||
52 | ||||||
53 | ||||||
54 | ||||||
55 |