Frictionless Data (Hyper Data) - Roadmap Detailed
 Share
The version of the browser you are using is no longer supported. Please upgrade to a supported browser.Dismiss

 
View only
 
 
ABCDEFGHIJKLMNOPQRSTU
1
data TitleDescriptionPriorityStreamOwnerSizeStatusProgressURLIssueContributors
2
1.1Data Package v1.0v1.0b. We have a pretty good working version. To get to 1.0 requires some consolidation but most of work is in sub-profiles e.g. JSON Table Schema2StandardsRufus Pollock80http://dataprotocols.org/data-packages/
3
1.2JSON Table Schema v1.0v1.0b. Just about to add primary key etc2StandardsRufus Pollock90http://dataprotocols.org/json-table-schema/
4
1.3Tabular Data Package v1.0Tabular Profile for Data Package (tabular data)

v1.0b. Only issue is that JSON Table Schema still being updated
2StandardsRufus Pollock85http://dataprotocols.org/simple-data-format/
5
1.4JSON Schemas for the formatsImportant for validation and checking implementations against spec2StandardsRufus Pollock80https://github.com/dataprotocols/schemashttps://github.com/dataprotocols/schemas/issues
6
1.5Data Package View spec1Standards25https://github.com/dataprotocols/dataprotocols/issues/77https://github.com/dataprotocols/dataprotocols/issues/77
7
1.6Geo Data PackageA profile / mini-spec for geo data specifically (similar to tabular data package spec)1StandardsJ Albert Bowden20https://github.com/dataprotocols/dataprotocols/issues/86https://github.com/dataprotocols/dataprotocols/issues/86
8
1.7Data package examples - GenericHave several examples done2Standards95http://github.com/datasetshttps://github.com/okfn/data.okfn.org/issues/35
9
1.8Data package examples - Tabular Data PackageHave several examples done2StandardsRufus Pollock, J Albert Bowden100http://github.com/datasets
10
1.9Data package examples - GeoOne example so far3Standards50http://github.com/datasetshttps://github.com/okfn/data.okfn.org/issues/64
11
1.11Data Package - tutorial and documentatione.g. interactive doc for key fields etc

Priority is lower because we also have stuff under outreach ...
2Standards40http://data.okfn.org/dochttps://github.com/okfn/data.okfn.org/issues/91
12
1.12Tabular Data Package - tutorial and docs2Standards20http://data.okfn.org/standards/simple-data-formathttps://github.com/okfn/data.okfn.org/issues/91
13
1.13Registry specSpec for a data package registry1Standards0
14
2.1Data Package Core Library (JS)Library that supports:

- create (init) data packages
- install
- publish
- view data packages

JS chosen for core library as potential to use both in browser and in classic code environment
3Core ToolsSebastien Ballesteros and Rufus PollockLarge60https://github.com/okfn/dpm
15
2.1.1Data Package Lib - create/initCreate data packages3Core ToolsRufus PollockSmall90https://github.com/okfn/datapackage-init
16
2.1.2Data Package Lib - viewView data packages (as HTML)3Core ToolsRufus PollockSmall25
17
2.1.2CSV Schema Inference LibraryInfer JSON Table Schema from a CSV

This is needed to do data package init / create effectively
2Core ToolsSebastien Ballesteros and Rufus PollockSmall80https://github.com/okfn/jts-infer
18
2.2Command Line "Data package manager"Command line tool to

- [ ] create (init) data packages
- [ ] install
- [ ] publish
- [ ] view data packages
3Core ToolsSebastien Ballesteros and Rufus Pollock50https://github.com/okfn/dpmhttps://github.com/okfn/dpm/issues
19
2.3Web-based data package managerOnline tool that supports (API and human user interface):

- create (init) data packages (including tabular packages with support for interactive specifiation of field types etc)
- publish
- view
- download

Note should ensure API accessiblity from the browser (CORS). This item has sub-items (see next items)
3Core ToolsRufus Pollock40http://data.okfn.org/tools
20
2.3.1Web-based create of data package3Core ToolsRufus Pollock60http://data.okfn.org/tools/createhttps://github.com/okfn/data.okfn.org/issues/68
21
2.3.2Web based viewing of data package3Core ToolsRufus Pollock100http://data.okfn.org/tools/view
22
2.4Python librarySome early stage work on a python library in https://github.com/tryggvib/datapackage1Core Tools80https://github.com/tryggvib/datapackagehttps://github.com/okfn/data.okfn.org/issues/171
23
2.5Ruby libraryEarly stage library at https://github.com/theodi/datapackage.rb1Core ToolsLeigh Dodds80https://github.com/theodi/datapackage.rb
24
2.6R Library2Core ToolsChristopher GandrudSmall70https://github.com/christophergandrud/dpmrhttps://github.com/okfn/data.okfn.org/issues/102
25
2.71.datapackage.json validation libValidate data packages (datapackage.json)2Core ToolsRufus Pollock80https://github.com/okfn/datapackage-validatehttps://github.com/okfn/datapackage-validate/issues
26
2.7.2datapackage.json Validation appOnline validation app for data packages (plus integration into dpm)2Core Tools80http://data.okfn.org/tools/validatehttps://github.com/okfn/data.okfn.org/issues/27
27
2.8.1Data validation library for tabular data packagesValidate **data** in the data package against the schema in the tabular data package2Core ToolsLeigh Dodds / ODI100https://github.com/okfn/data.okfn.org/issues/67https://github.com/okfn/data.okfn.org/issues/67
28
2.8.2Data validation app for tabular data packagesOnline app for validating tabular data2Core ToolsLeigh Dodds / ODI100https://github.com/okfn/data.okfn.org/issues/67https://github.com/okfn/data.okfn.org/issues/67
29
2.9Reference registry implementationCore ToolsRufus Pollock80http://data.okfn.org/datahttps://github.com/okfn/dpm/issues/5
30
3.1R integrationBuild on basic library to provide full integration (publish, consume etc)2Integration30https://github.com/okfn/data.okfn.org/issues/102
31
3.2CKAN integrationPublish and install. Use of CKAN as a registry and data store2IntegrationRufus Pollock50https://github.com/okfn/data.okfn.org/issues/126https://github.com/okfn/data.okfn.org/issues/126
32
3.3Relational DatabasesScripts for automated install into relational databases like Postgres, SQLite, MySQL etc.

Some work already done - see http://data.okfn.org/tools
1Integration20https://github.com/okfn/data.okfn.org/issues/97https://github.com/okfn/data.okfn.org/issues/97
33
3.4ExcelPublish and consume from Excel (via WebQueries consume in simplest sense is quite straightforward)1Integration0https://github.com/okfn/data.okfn.org/issues/41https://github.com/okfn/data.okfn.org/issues/41
34
3.5Google Spreadsheet- Import
- Export
1IntegrationMatt FullertonMedium15https://github.com/okfn/datapackage-to-google-spreadsheethttps://github.com/okfn/data.okfn.org/issues/24
35
3.6OpenRefine2Integration0https://github.com/okfn/data.okfn.org/issues/103
36
3.7App for publishing data from local machineBrowser plugin or similar would be fine1Integration0
37
3.8BigqueryImport and export data from BigQuery1Integration0https://github.com/okfn/data.okfn.org/issues/128
38
3.9RedshiftImport and export data from BigQuery1Integration0https://github.com/okfn/data.okfn.org/issues/127
39
3.10MatlabMatlab library to consume and publish data packages1IntegrationKris Krusano80https://github.com/KrisKusano/datapackagehttps://github.com/okfn/data.okfn.org/issues/115
40
3.20Data APIService or deployable software app which takes a Tabular Data Package and automatically generates a web service with a nice API

Can do this via other items e.g. via CKAN DataStore
2Integration50https://github.com/okfn/data.okfn.org/issues/126
41
3.21DataCatalog.jsData Catalog in a single file JS app

- List of data packages
- datacatalog.js - see existing code Git and Github for Data - draft post
- host on s3 / file system / dropbox etc or similar ...
1Integration0https://github.com/okfn/datapackage-catalog
42
3.30DatSupport for Dat and general work on syncing APIsIntegrationMax Ogden0https://github.com/okfn/datapackage-catalog
43
4.1Project Website3OutreachRufus PollockMedium100http://data.okfn.org/
44
4.2Vision and Concept2OutreachRufus PollockMedium100http://data.okfn.org/vision
45
4.3Roadmap for projectReasonably detailed roadmap for project3OutreachRufus PollockMedium100http://data.okfn.org/roadmaphttps://github.com/okfn/data.okfn.org/issues/93
46
4.4Slide-deck introductionReasonably complete ...2OutreachRufus PollockSmall85http://data.okfn.org/
47
4.5IRC ChannelProject IRC channel. Located at #hyperdata2OutreachMax OgdenSmallDone100http://webchat.freenode.net/?channels=okfn
48
4.6News aggregator- bot for irc channel
- aggregator site / channel
2OutreachMedium0
49
4.7Twitterhyperdata on twitter is taken but frictionless data is notOutreach0
50
4.10Posts on exemplar dataset data packages1Outreach0
51
4.11Publish Tabular data tutorial2Outreach100http://data.okfn.org/doc/publish-tabularhttps://github.com/okfn/data.okfn.org/issues/87
52
4.12Publish Geodata tutorial2Outreach20http://data.okfn.org/doc/publish-geodatahttps://github.com/okfn/data.okfn.org/issues/90
53
4.13Publish from google docs tutorial2Outreach0
54
4.14Posts on tooling1 post on each example1Outreach0
55
4.15Dataset analysis with multiple datasets example (R)e.g. Example - House prices regressed on long interest rate and GDP (and population)

* [x] House price data - http://data.okfn.org/data/house-prices-uk
* [x] UK Long interest rate - http://data.okfn.org/data/bond-yields-uk-10y
* [x] UK GDP - http://data.okfn.org/data/gdp-uk

Existing: example merging 2 datasets to get deflated data. http://explorer.okfnlabs.org/#rgrp/e3e0b0f18dfe151f9f7e

High priority because this can drive everything else.
3Outreach0https://github.com/okfn/data.okfn.org/issues/32
56
5.1Core Datasets ProjectEssential datasets as data packagesExtrasRufus Pollock30https://github.com/datasetshttps://github.com/datasets/registry/issues
57
5.2Pattern - GithubHow to use github to store data packagesExtras20https://github.com/datasets
58
5.3Data Converters[Placeholder] Convert data between different formatsExtras40http://okfnlabs.org/dataconverters/
59
5.4Github data package hook to push to e.g. CKAN instanceExtras0
60
5.5Cleaning as a service - Travis + Scraperwiki joinup Extras0
61
5.6Tabular Stats toolGiven an Tabular Data Package compute stats for each tabular resource (sum, avg etc)Extras5https://github.com/okfn/data.okfn.org/issues/33
62
5.7Data visualizer from data packages online - "Data Explorer"Pull together different data packages and visualize onlineExtras0
63
5.8Data DeckClean, transform data in the browser (and make data packages)Extras0
64
5.9Browser FarmScraping data in the browserExtras
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
Loading...
 
 
 
Sheet1
 
 
Main menu