European Data Science Academy Dataset Register #open


1	European Data Science Academy Dataset Register
2
3	This database contains metadata relating to the datasets used and generated within the EDSA project. The database acts as a catalog providing background information on each dataset, their method of collection and, where published, how to access them
4
5	The EDSA data management plan can be found at:
6	http://edsa-project.eu/edsa-data/uploads/2015/02/EDSA-2015-P-D55-FINAL.pdf
7
8	Table of Contents
9	Introduction	Metadata
10	V1.2 - DMP M12	The dataset register
11	DMP Field Description	A list of the fields used to construct the register
12	DMP Code Lists	Codes and abbreviations used in specific fields
13
14
15	Licence
16	The entirety of this work is licenced under a Creative Commons - Attribution 4.0 (CC BY 4.0)
17
18	Certificate
19	This work has an Open Data Certificate
20
21	Contact
22	If you have any questions, suggestions or comments, please don't hesitate to email us at: training@theodi.org
23
24	Published
25	26/05/2016
26
27	Last updated
28	07/07/2016
29
30	Please cite as
31	The European Data Science Academy Register (2016) The Open Data Institute
32
33	To open in Google sheets:
34	https://docs.google.com/spreadsheets/d/1VKzVUMbfEuH5eriQvw5Wtc5jqnSh-_av_7Z8iUMHYHA/


1		Data set reference and name						Data set description					Standards			Data sharing									Archiving and preservation					Data Ethics
2	Relevant to DMP "Has the dataset been used to infer results of research?"	Work Package	Organisation	Dataset Title	Dataset Identifier	Status - January 2018 (ongoing, in progress, due date)	New entry to data management plan since M18? Yes/No	Generated or collected	Origin	Scale	Who is this useful for?	Similar existing dataset and possibility for integration? Value of this new dataset?	What standards and methodologies will be utilised for data collection and management?	Outline the metadata, documentation or other supporting material that should accompany the data for it to be interpreted correctly	Status and location of metadata, documentation or other supporting material	Licensing, data protection, ownership and copyright	Can the data be published under an open licence?	If the data cannot be published openly, why?	How will the data be shared? (including access procedures, dissemination, software/tools needed for enabling reuse	Which repository will be used for the data? Why this respository?	Is it ready to be published?	Current location of dataset	Dataset Link	Licence	How long should the data be preserved? How will it exceed the length of the project if necessary?	Approx end volume	Who is responsible in your organisation for the data managament and curation?	Quality assurance and back up procedures?	Associated costs and how these will be covered - do you need to purchase storage? How much time will it take for a person to manage the data - how will this be covered?	Are there any ethical or legal issues that can have an impact on sharing this data? Y/N	What are the ethical or legal issues, if any, that can occur from sharing this data?	Is informed consent for data sharing and long term preservation included in questionnaires dealing with personal data? Y/N/NA

3	Yes	WP1	ODI	Corpora of crawled web-based adverts from LinkedIn	WebSiteHarvest	Finished	No	Collected	LinkedIn	46 terms, 31 languages, 47 countries, 1 harvest per day, 2162 data points per day	Internal demand analysis only.	Many datasets are collected in this area, however due to the specific nature of this study, collection of new data is required and integration with existing datasets not viable. The value of this dataset comes from the provision of an up-to-date snapshot of current data science skills needs across the EU.	All data collected is translated into CSV format.	Data will be not available for reuse or accessible by anyone outside of the project. The data collected will be used for internal analysis to inform the creation of curriculum.	Metadata is not publically available	The terms of the LinkedIn user agreement now forbid harvesting and collection of data without express permission. When the data was collected, this was not the case. https://www.linkedin.com/legal/user-agreement?trk=hb_ft_userag	No	The terms of the LinkedIn user agreement forbid harvesting and collection of data without express permission. "Use manual or automated software, devices, scripts robots, other means or processes to access, “scrape,” “crawl” or “spider” the Services or any related data or information;" https://www.linkedin.com/legal/user-agreement?trk=hb_ft_userag	Data will be not shared or available for reuse	Using Github so that the data stays close to its usage and can be used quickly and easily.	N/A	N/A	N/A	N/A	Until the end of the project	<1Gb	ODI lead data management and curation, other WP1 partners will contribute	Backed up to an internal ODI repository	Approximately 1 day person effort per month	Y	Internal demand analysis only	NA
4	Yes	WP1	ODI	Aggregated statistics of European skill demand based on web-based job adverts	WebSiteStatistics	Finished	No	Collected	Adzuna API, Trovit	Varied	Populating the dashboard, internal demand analysis and to inform curriculum development.	Many datasets are collected in this area, however due to the specific nature of this study, collection of new data is required and integration with existing datasets not viable. The value of this dataset comes from the provision of an up-to-date snapshot of current data science skills needs across the EU.	All data collected is translated into CSV format.	The Adzuna data is accessible via the Adzuna API. The Trovit data will be not available for reuse or accessible by anyone outside of the project.	Metadata is not publically available	The data will be available for use via the EDSA dashboard However it will not be available to download as this contravenes Trovit’s terms and conditions.	No	Trovit’s terms of use prohibit the use of their data. The research exception allows us to use the data but not to make it available in raw format for others to consume for commercial purposes.	Via the EDSA dashboard	In an internal JSI repository	N/A	N/A	N/A	N/A	Until the end of the project	<1Gb	ODI lead data management and curation, other WP1 partners will contribute	Backed up in an internal JSI repository	Approximately 1 day person effort per month	Y	Data can only be used for research purposes	NA
5	Yes	WP1	ODI	Individual results from demand analysis	IndividualResponses	Ongoing	No	Generated	Interviews and survey	584 surveys, 108 interviews at present. Online survey still open.	Internal demand analysis.	A number of surveys exist in this domain but their data is not available to this project. This data will enable EDSA to build up a country by country view of current capacity and requirements for data science skills.	Data collection methods outlined in D1.4. Translated into CSV format.	Data will be not shared or available for reuse. The data collected will be used for internal analysis to inform the creation of curriculum. Anonymised data will be publicly available.	Metadata is not publically available	Raw data will be owned by the project and unlicensed. It will not be available for reuse.	No	Data protection of personal data	Data will be not shared or available for reuse	Internal ODI repository	N/A	N/A	N/A	N/A	Until the end of the project	<100Mb	ODI lead data management and curation, other WP1 partners will contribute	Backed up to an internal ODI respository	Approximately 1 day effort per month	Y	Contains personal data	N
6	Yes	WP1	ODI	Summary data from surveys and interviews	DemandAnalysisSummary	Finished	No	Generated	Interviews and survey	585 surveys, 108 interviews.	External analysis of respondents who took the surveys and interviews.	None	Data collection methods outlined in D1.4. Translated into CSV format.	A README.md file is available detailing the data structure and basic usage.	https://theodi.github.io/edsa-demand-analysis-summary-data/	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	Yes	N/A	Data will be available to access from the EDSA website and the ODIs Github repository.	Github/ EDSA website	Yes	https://theodi.github.io/edsa-demand-analysis-summary-data/	https://theodi.github.io/edsa-demand-analysis-summary-data/	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	As long as Github exists as a minimum. Beyond that a value judgement would have to be made.	<100Mb	ODI lead data management and curation, other WP1 partners will contribute	Stored in external repositories - EDSA website and Github	Github free and public	No	None	N/A
7	Yes	WP1	ODI	De-identified survey responses from demand analysis	DeidentifiedResponses	Ongoing	No	Generated	Survey	496 survey results	External analysis of results and trends by anyone who wishes to gather survey data in the area of data science	There are a number of other surveys that have been aggregated that we can compare our result too and use these results if necessary. This dataset has the same eventual value to others in the area	Data collection methods outlined in D1.4. Translated into CSV format.	A README.md file is available detailing the data structure and basic usage.	http://davetaz.github.io/quantitative-data-from-edsa-demand-analysis-/	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	Yes	N/A	Data will be available to view on the EDSA dashboard and accessible for free in the EDSA dashboard Github repository.	Github/ EDSA Dashboard on website	Yes	Github/ EDSA Dashboard on website	http://davetaz.github.io/quantitative-data-from-edsa-demand-analysis-/	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	As long as Github exists as a minimum. Beyond that a value judgement would have to be made.	<100Mb	ODI lead data management and curation, other WP1 partners will contribute	Stored in external repositories - EDSA website and Github	Github free and public	No	None	N/A
8	Yes	WP1	ODI	Recordings and transcriptions of interviews	InterviewTranscipts	Finished	No	Generated	Interviews	108 transcripts, 108 recordings	Internal demand analysis only	No similar datasets exist that are usable for this project. The interviews provide insights and data points for use in the demand analysis.	Qualitative research methodology for collection outlined in D1.4	Data will be not available for reuse or accessible by anyone outside of the project. The data collected will be used for internal analysis to inform the creation of curriculum.	N/A	Raw data will be owned by the project and unlicensed. It will not be available for reuse.	No	Data protection of personal data	Data will be not shared or available for reuse. The data collected will be used for internal review to inform the creation of curriculum and will only be available publically as anonymous data	Internal ODI repository	N/A	N/A	N/A	N/A	Until the end of the project	< 3GB	ODI lead data management and curation, other WP1 partners will contribute	Backed up to an internal ODI respository	As part of the subcontracting costs of WP1	Y	Raw data including personal data	No
9	No	WP1	ODI	ideXlab search platform results	ExpertIdentification	Ongoing	No	Collected	Research publications	Final scale not yet known as collection is ongoing	Internal demand analysis and to inform curriculum development. Provides insights into offer side of skills analysis.	Not in this area. This dataset will provide validation of the demand analysis and form the basis for further insights.	The ideXlab search engine will use the sampling approach outlined in D1.2. for data collection. CSV data will be created	Data will be not available for reuse or accessible by anyone outside of the project. The data collected will be used for internal analysis to inform the creation of curriculum.	Accompanying document to explain data structure. This will not be made open.	Raw data will be owned by the project and unlicensed. It will not be available for reuse.	No	Data protection of personal data	The data will not be shared due to restrictions on the use of personal data.	ideXlab search platform	N/A	N/A	N/A	N/A	Until the end of the project	Est. 1000 returns	ideXlab lead data management and curation, other WP1 partners will contribute	Backed up to an internal ideXlab respository	Approx 2 person days per month. No other external costs	Y	Raw data including personal data	No
10	Yes	WP1	JSI	trainings repository	TrainingRepository	Ongoing	No	Both	Trainings APIs, training websites, Wikifer processing	>50.000 offline and online trainings (within different fields)	EDSA dashboard	This is an extensive cross-lingual dataset, that covers a wide spectrum of trainings. Each training is processed and semantically annotated.	JSON	Data is available within project, statistics is available on request.	For Wikifier annotations - Wikifier.org	Raw data will be owned by the project and unlicensed.	N/A	N/A	Data is shared via EDSA dashboard.	QMiner (JSI platform)	N/A	JSI server	N/A	N/A	At least until the end of the project	N/A	JSI participates in EDSA dashboard data collection and development	Backed up regularly	N/A	No	None	N/A
11	Yes	WP1	JSI	Job repository	JobRepository	Ongoing	No	Both	Job APIs, Job websites, Wikifier processing	> 3.000.000 jobs	EDSA dashboard	This is an extensive cross-lingual dataset, that covers a wide spectrum of European countries. Each job announcement is processed and semantically annotated.	JSON	Data is available within project, statistics is available on request.	For annotation with skills - SARO ontology, for Wikifier annotations - Wikifier.org, for geolocations - Geonames	Raw data will be owned by the project and unlicensed.	No	N/A	Data is shared via EDSA dashboard.	QMiner (JSI platform)	N/A	JSI server	N/A	N/A	At least until the end of the project	N/A	JSI participates in EDSA dashboard data collection and development	Backed up regularly	N/A	N/A	N/A	N/A
12	Yes	WP2	ODI	Related course data regarding similar modules and training offerings across the EU	DataScienceCourses	Finished	No	Collected	Course websites	600 KB	Internal use for development of curricula and learning materials. External use for identfying useful courses	None. The data will provide a useful resource for those wishing to understand what courses are available.	Systematic search and review of available data science courses. The search terms were Data Science, Big Data, Data Analytics, Business Analytics, Machine Learning, Distributed Computing, Advanced Computing Data Science Stream, Data Analytics stream.	Metadata has been published alongside the data	https://theodi.github.io/data-science-courses-in-europe-2016/	The data is licensed under a Creative Commons CC-BY 4.0 licence	Yes	N/A	GitHub/EDSA website	Github, EDSA website	Yes	https://theodi.github.io/data-science-courses-in-europe-2016/	https://theodi.github.io/data-science-courses-in-europe-2016/	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	Until the end of the project	< 1GB	ODI lead data management and curation	Backed up to an internal ODI repository	0.5 days per month	N	None	N/A
13	No	WP2	Persontyle	Datasets for course examples and exercises	Using namespace notation to specify R packages: sml::poly4, sml::poly4b, sml::kmeans, sml::seeds, car::Duncan, car::Davis, datasets::car, datasets::HairEyeColor, datasets::Airquality, datasets::swiss, bestGLM::zprostate, MASS::menarche	Finished	No	Both	Various - many from third party R packages students download from CRAN. Some in an author developed package.	12 small datasets. <1MB	Students in the "Essentials of Data Analytics and Machine Learning" course.	Third party R packages students download from CRAN. Some in an author developed package hosted on CRAN	None	The datasets will be used within learning activities offered as part of the "Essentials of Data Analytics and Machine Learning" course. They are stored in the sml R package.	Package documentation (except, currently, for those in the sml package)	GNU GPL V3, http://www.gnu.org/licenses/gpl-3.0.en.html	Yes	N/A	Via R packages, searchable online.	CRAN	Yes	CRAN, except for sml package which is currently available on the EDSA portal and will move to CRAN when finished.	https://vincentarelbundock.github.io/Rdatasets/datasets.html	GNU GPL V3, http://www.gnu.org/licenses/gpl-3.0.en.html	As long as the owners do not remove them. If the datasets are no longer accessible, other similar datasets will be used in the module.	< 1MB	Persontyle lead data management and curation, third parties for collected data	Relying on CRAN	None	No	None	N/A
14	No	WP2	TU/e	Event log from a municipality process	a07386a5-7be3-4367-9535-70bc9e77dbe6	Finished	No	Collected	Dutch municipality	200 KB	Users interested in real life event logs.	We have a large collection of real life event logs at http://data.3tu.nl/repository/collection:event_logs_real	Management throuh 3TU data center	Includes number of traces, events, attributes, timespan, etc.	http://data.3tu.nl/repository/uuid:a07386a5-7be3-4367-9535-70bc9e77dbe6	Non-commercial licence	No	The data is shared and publically available for non-commercial reuse. Its non-commercial licence means it cannot be published openly.	http://data.3tu.nl/repository/uuid:a07386a5-7be3-4367-9535-70bc9e77dbe6	http://data.3tu.nl/repository/uuid:a07386a5-7be3-4367-9535-70bc9e77dbe6	Yes	http://data.3tu.nl/repository/uuid:a07386a5-7be3-4367-9535-70bc9e77dbe6	http://data.3tu.nl/repository/uuid:a07386a5-7be3-4367-9535-70bc9e77dbe6	unknown	The data is stored in long-term storage so will be available for years to come	200 KB	3TU	Reliant on third party. If the dataset becomes unavailable we will use a similar one in the online module.	none	No	None	No
15	No	WP3	JSI	Repository statistics on downloads and views of educational resources	RepositoryStatistics	Available, regularly updated	No	Collected	videolectures.net	views and comments for each videolecture	internal analysis, curriculum development, external demand analysis	None. Provides evidence of resource usage and basis for improving curriculum, content and course structure.	CSV is used for Videolectures API	Videolectures REST api documentation. An MD Readme file is available for download	https://github.com/innanoval/edsa-videolectures-statistics-dataset-1/tree/gh-pages/data	The data is licensed under a Creative Commons CC-BY 4.0 licence	Yes	N/A	Available to see at videolectures website; described as part of WP3 deliverables	videolectures repository. Proximity to data source.	Yes	JSI server	https://github.com/innanoval/edsa-videolectures-statistics-dataset-1/tree/gh-pages/data	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	the data will be available after the project ends as part of the project's learning materials	< 1GB	JSI lead data management and curation. OU contribute	videolectures - relying on internal quality assurance & back up procedures	Approximately 1 day per month during the project’s lifetime	No	None	N/A
16	No	WP3	OU	Learning Analytics data generated from the EDSA Online Courses portal	EDSAOnlineCoursesLA	Ongoing. Generation of data started on 01/02/2016, together with the launch of the first EDSA courses	No	Generated	http://courses.edsa-project.eu	Not yet known	Course producers can get an understanding of how their courses are being used. Learners can monitor their learning progress.	Not many Learning Analytics datasets are publicly available. The OU has recently published a similar dataset: https://analyse.kmi.open.ac.uk/open_dataset	The xAPI specification is used for expressing the data; the open source Learning Locker software is used for storing and visualising the data.	Introduction to the xAPI (or Tin Can API): https://tincanapi.com/overview/. Introduction to Learning Locker: https://learninglocker.net	https://tincanapi.com/overview/ https://learninglocker.net https://alexmikro.github.io/learning-analytics-dataset-from-the-edsa-online-courses-portal/	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	Yes	N/A	Via the EDSA website / Github	We have setup a dedicated EDSA Learning Locker. This was chosen for the reasons outlined in https://learninglocker.net/benefits/	Yes	EDSA Learning Locker	https://alexmikro.github.io/learning-analytics-dataset-from-the-edsa-online-courses-portal/	CC-BY 4.0	Until the end of project	Not yet known	OU lead data management and curation.	Relying on the backup procedures of the OU, as the dataset is hosted on an OU server.	Server storage has already been purchased. Effort for analysing the data has been allocated in Task 3.4.	No, this dataset is anonymised.	None	N/A
17	No	WP3	JSI	Internal logs of elearning systems	InternalLogs	Available, regularly updated	No	Collected	videolectures.net	for videolectures: 20.000 videos, 17.431 lectures, 12.998 authors, 952 events, 579 categories	internal demand analysis	None. Provides evidence of resource usage and basis for improving curriculum, content and course structure.	JSON is used for Videolectures API	Videolectures REST api documentation	N/A	Raw data will be owned by the project and unlicensed. It will not be available for reuse.	No	Privacy. Data requires anonymisation and/or aggregation, and at the moment the use case for anonymised data is not clear.	Available to see at videolectures website; described as part of WP3 deliverables	videolectures repository. Proximity to data source.	N/A	JSI server	N/A	N/A	at least until the end of project	N/A	JSI lead data management and curation. OU contribute	videolectures - relying on internal quality assurance & back up procedures	N/A	Yes	Privacy	N/A
18	No	WP3	JSI	Statistics of course registration, participation and completion	StatisticsForCourses	Available, regularly updated	No	Collected	videolectures.net	for videolectures - available per videolecture, per viewer	internal demand analysis	None. Provides basis for improving curriculum, content and course structure.	JSON is used for Videolectures API	Videolectures REST api documentation	N/A	Raw data will be owned by the project and unlicensed. It will not be available for reuse.	No	Privacy. Data that does not contain privacy issues might be publishable	Available to see at videolectures website; described as part of WP3 deliverables	videolectures repository. Proximity to data source.	N/A	JSI server	N/A	N/A	at least until the end of project	< 1GB	JSI lead data management and curation. OU contribute	videolectures - relying on internal quality assurance & back up procedures	N/A	No	None	N/A
19	No	WP3	JSI	Aggregated statistics of engagement with the developed courses and educational resources	AggregatedStatistics	Available, regularly updated	No	Generated	videolectures.net	for videolectures - available per videolecture, per viewer	internal demand analysis	None. Provides evidence of adoption and basis for improving curriculum, content and course structure.	JSON is used for Videolectures API	Videolectures REST api documentation	N/A	Raw data will be owned by the project and unlicensed. It will not be available for reuse.	No	Privacy. Data that does not contain privacy issues might be publishable	Available to see at videolectures website; described as part of WP3 deliverables	videolectures repository. Proximity to data source.	N/A	JSI server	N/A	N/A	at least until the end of project	< 1GB	JSI lead data management and curation. OU contribute	videolectures - relying on internal quality assurance & back up procedures	N/A	No	None	N/A
20	No	WP3	TU/e	Recorded behavior of students following the first session of the process mining MOOC	CourseraMOOCprocmin001	Ongoing	No	collected	coursera.org	several large tables	learning analytics within EDSA	every Coursera course has this data recorded	Data collection is managed by Coursera	There is no external link to the metadata	N/A	Raw data is owned by TU/e and cannot be shared due to Coursera restrictions of use.	No	Restrictions of use from the data provider	N/A	The data is collected by and stored on a Coursera repository.	No	Coursera	N/A	N/A	N/A	around 1 GB	Joos Buijs, Tu/e lead data management and curation	relying on coursera	N/A	Yes	Student identifiable data	No
21	No	WP4	SOTON	Web server logs and Google analytics of project website access	WebsiteAnalytics	Ongoing	No	Collected	http://edsa-project.eu	1 website	Internal analysis for dissemination and community analysis. Secondary use for implicit demand analysis.	None. Provides evidence of engagement and basis for UX improvement.	Quantitative recording of website traffic via Google Analytics dashboard, analysed using a variety of analytic tools.	Sessions, Page views, Demographics, User Flow, Bounce rate,	There is no external link to the metadata	Raw data will be owned by the project and unlicensed. It will not be available for reuse.	No	User privacy. The data can be aggregated and published under an open license	Analysed data will be made available throughout deliverable reports in WP4.	Internal institutional Soton/OU repositories	N/A	https://analytics.google.com/	N/A	N/A	at least until the end of project	< 1GB	OU lead data management and curation. Soton contribute	Backed up remotely	Free storage. 0.5 day per month	Yes	Google analytics and web log data contain information which could be used to identify individuals	N/A
22	No	WP4	SOTON	Generated social media engagement data	SocialMediaEngagements	Ongoing	No	Collected	Twitter	1 Twitter Account	Internal analysis for community strength and project dissemination.	None that relate to EDSA. Provides evidence for engagement with project, effectiveness of dissemeniation activities. Provides basis for understanding what content users find most engaging.	Regular access of data from analytics.twitter.com	Tweets, Impressions, Profile Visits, Followers, Mentions	https://analytics.twitter.com/user/edsa_project/home	Data will be licensed in compliance with each social network's terms and conditions	No	Data sharing needs to comply with individual site licenses. However the majority of social networks do not permitted collection, harvesting and republication of data	Dashboard on EDSA website. Deliverable reports in WP4.	Internal institutional Soton repositories		Data not accessible directly without tools. Required Twitter harvester.			Until the end of the project	< 1GB	Soton lead data management and curation.	Backed up remotely	Free storage. 1 day per month	Yes	Subject to license conditions from the social network	N/A
23	No	WP5	ideXlab	List of project exploitation results – collaborations, institutional and geographical beneficiaries,	ProjectExploitation	Ongoing	No	Generated	Project partners	Variable	Internal analysis for results to be exploited and targets	None. Provides data on dissemination activity, network and results.	Report detailing results from interviews and exploitation activities	N/A	N/A	Raw data will be owned by the project and unlicensed. It will not be available for reuse.	No	Confidentiality, data obsolescence	Deliverable reports in WP5.	Google docs shared document	No	Data not accessible directly.	N/A	N/A	Until the end of the project	200 KB	ideXlab lead data management curation	Backed up remotely	Free storage. 1 day per month	No	None	NA
24	No	WP5	ODI	The EDSA Register	EDSARegister	Ongoing	No	Generated	Project partners	<500KB	Anyone interested in understanding the datasets used within the EDSA project. Internal management tool.	None	Project partners update every three months until the end of the project. ODI responsible for conversion to CSV and publication as open data.	A README.md file is available detailing the data structure and basic usage.	https://theodi.github.io/european-data-science-academy-register/	This dataset is published on Github, under a CC-BY licence.	Yes	N/A	Via Github and via the EDSA website (http://edsa-project.eu/resources/datasets/)	Google docs shared document and Github	Yes	https://theodi.github.io/european-data-science-academy-register/	https://theodi.github.io/european-data-science-academy-register/	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	As long as Github exists as a minimum. Beyond that a value judgement would have to be made.	< 500MB	ODI lead data management and curation, other WP1 partners will contribute	Stored in external repositories - EDSA website and Github	Stored in external repositories - EDSA website and Github; approximately 2 days per month effort for maintenance.	Yes	Has links to de-annoynamised data	No
25	No	WP3	TU/e	FutureLearn course run data 'Introduction to process mining with ProM'	FLMOOC-procmin1	Ongoing	Yes	Collected	https://www.futurelearn.com/admin/courses/process-mining/1/	<10Mb	Learning analytics within EDSA	One of several datasets of FutureLearn course behavior data, interesting for comparison between sessions and runs.	Data collection is managed by FutureLearn	https://partners.futurelearn.com/data/datasets/	N/A	Raw data is owned by TU/e and cannot be shared outside the EDSA project due to FutureLearn restrictions of use.	No	User privacy. The data can be aggregated and published under an open license	Analysed data will be made available throughout deliverable reports in WP3.	Local storage at TU/e, to store privacy sensitive data.	N/A	FutureLearn	N/A	N/A	N/A	<10MB	Joos Buijs, Tu/e lead data management and curation	Relying on FutureLearn	N/A	Yes	Student identifiable data	No
26	No	WP2	ODI	Monthly Rainfall (mm) Totals for Selected Stations in Tanzania, 2014	Tanzania_Rainfall	Ongoing	Yes	Collected	http://training.theodi.org/InPractice/inpractice1/course/en/exercises/Tanzania_Rainfall.pdf	<66KB	Anyone interested in understanding the exercises within the finding stories curriculum	None.	None	The datasets will be used within learning activities offered as part of the "Finding stories in Data" course.	Modules 4 - Gathering Data	This dataset is published on Github, under a CC-BY licence.	Yes	N/A	Via Github and via the EDSA website (http://courses.edsa-project.eu/course/view.php?id=52)	Github, EDSA website	N/A	EDSA Website	http://training.theodi.org/InPractice/inpractice1/course/en/exercises/Tanzania_Rainfall.pdf	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	N/A	<66KB	David Tarrant, ODI	Github	N/A	No	None	N/A
27	No	WP2	ODI	BBC RSS Feed	BBCnews	Ongoing	Yes	Collected	http://feeds.bbci.co.uk/news/rss.xml	1 Twitter account	Anyone interested in understanding the exercises within the finding stories curriculum	None	None	The datasets will be used within learning activities offered as part of the "Finding stories in Data" course.	Modules 4 - Gathering Data	This data is publicly available from an external source	Yes	N/A	Via Github and via the EDSA website (http://courses.edsa-project.eu/course/view.php?id=52)	N/A	N/A	EDSA Website	http://feeds.bbci.co.uk/news/rss.xml	N/A	N/A	Unknown	David Tarrant, ODI	N/A	N/A	No	None	N/A
28	No	WP2	ODI	Health Facility list ratings Tanzania	healthfacilitiy	Ongoing	Yes	Collected	https://drive.google.com/file/d/0B1VBoooQ3X5jeEQycHo4OG4tclE/view	<22KB	Anyone interested in understanding the exercises within the finding stories curriculum	None	None	The datasets will be used within learning activities offered as part of the "Finding stories in Data" course.	Modules 4 - Gathering Data	This dataset is published on Github, under a CC-BY licence.	Yes	N/A	Via Github and via the EDSA website (http://courses.edsa-project.eu/course/view.php?id=52)	Github, EDSA website	N/A	EDSA Website	https://drive.google.com/file/d/0B1VBoooQ3X5jeEQycHo4OG4tclE/view	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	N/A	<22KB	David Tarrant, ODI	Github	N/A	No	None	N/A
29	No	WP2	ODI	Louisiana Secretary of State Officials	Dataset1	Ongoing	Yes	Collected	http://www.sos.la.gov/tabid/136/Default	>2.5MB	Anyone interested in understanding the exercises within the finding stories curriculum	None	None	The datasets will be used within learning activities offered as part of the "Finding stories in Data" course.	Module 6 - Cleaning Data	This dataset is published on Github, under a CC-BY licence.	Yes	N/A	Via Github and via the EDSA website (http://courses.edsa-project.eu/course/view.php?id=52)	Github, EDSA website	N/A	EDSA Website	http://training.theodi.org/resources/dataset1.xls	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	N/A	>2.5MB	David Tarrant, ODI	Github	N/A	No	None	N/A
30	No	WP2	ODI	US Projects Dataset	Dataset2	Ongoing	Yes	Collected	http://www.itdashboard.gov/data_feeds.	<2MB	Anyone interested in understanding the exercises within the finding stories curriculum	None.	None	The datasets will be used within learning activities offered as part of the "Finding stories in Data" course.	Module 6 - Cleaning Data	This dataset is published on Github, under a CC-BY licence.	Yes	N/A	Via Github and via the EDSA website (http://courses.edsa-project.eu/course/view.php?id=52)	Github, EDSA website	N/A	EDSA Website	http://training.theodi.org/resources/dataset2.csv	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	N/A	<2MB	David Tarrant, ODI	Github	N/A	No	None	N/A
31	No	WP2	ODI	UK GP Earnings	Dataset3	Ongoing	Yes	Collected	http://data.gov.uk/dataset/gp-earnings-and-expenses-2009-10	<3KB	Anyone interested in understanding the exercises within the finding stories curriculum	None.	None	The datasets will be used within learning activities offered as part of the "Finding stories in Data" course.	Module 6 - Cleaning Data	This dataset is published on Github, under a CC-BY licence.	Yes	N/A	Via Github and via the EDSA website (http://courses.edsa-project.eu/course/view.php?id=52)	Github, EDSA website	N/A	EDSA Website	http://training.theodi.org/resources/dataset3.csv	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	N/A	<3KB	David Tarrant, ODI	Github	N/A	No	None	N/A


1	Data set reference and name						Data set description					Standards			Data sharing									Archiving and preservation
2	Work Package	Organisation	Dataset Title	Dataset Identifier	Status - July 2016 (ongoing, in progress, due date)	New entry to data management plan since M6? Yes/No	Generated or collected	Origin	Scale	Who is this useful for?	Similar existing dataset and possibility for integration? Value of this new dataset?	What standards and methodologies will be utilised for data collection and management?	Outline the metadata, documentation or other supporting material that should accompany the data for it to be interpreted correctly	Status and location of metadata, documentation or other supporting material	Licensing, data protection, ownership and copyright	Can the data be published under an open licence?	If the data cannot be published openly, why?	How will the data be shared? (including access procedures, dissemination, software/tools needed for enabling reuse	Which repository will be used for the data? Why this respository?	Is it ready to be published?	Current location of dataset	Dataset Link	Licence	How long should the data be preserved? How will it exceed the length of the project if necessary?	Approx end volume	Who is responsible in your organisation for the data managament and curation?	Quality assurance and back up procedures?	Associated costs and how these will be covered - do you need to purchase storage? How much time will it take for a person to manage the data - how will this be covered?
3	WP1	ODI	Corpora of crawled web-based adverts from LinkedIn	WebSiteHarvest	Finished	No	Collected	LinkedIn	46 terms, 31 languages, 47 countries, 1 harvest per day, 2162 data points per day	Internal demand analysis only.	Many datasets are collected in this area, however due to the specific nature of this study, collection of new data is required and integration with existing datasets not viable. The value of this dataset comes from the provision of an up-to-date snapshot of current data science skills needs across the EU.	All data collected is translated into CSV format.	Data will be not available for reuse or accessible by anyone outside of the project. The data collected will be used for internal analysis to inform the creation of curriculum.	Metadata is not publically available	The terms of the LinkedIn user agreement now forbid harvesting and collection of data without express permission. When the data was collected, this was not the case. https://www.linkedin.com/legal/user-agreement?trk=hb_ft_userag	No	The terms of the LinkedIn user agreement forbid harvesting and collection of data without express permission. "Use manual or automated software, devices, scripts robots, other means or processes to access, “scrape,” “crawl” or “spider” the Services or any related data or information;" https://www.linkedin.com/legal/user-agreement?trk=hb_ft_userag	Data will be not shared or available for reuse	Using Github so that the data stays close to its usage and can be used quickly and easily.	N/A	N/A	N/A	N/A	Until the end of the project	<1Gb	ODI lead data management and curation, other WP1 partners will contribute	Backed up to an internal ODI repository	Approximately 1 day person effort per month
4	WP1	ODI	Aggregated statistics of European skill demand based on web-based job adverts	WebSiteStatistics	Finished	No	Collected	Adzuna API, Trovit	Varied	Populating the dashboard, internal demand analysis and to inform curriculum development.	Many datasets are collected in this area, however due to the specific nature of this study, collection of new data is required and integration with existing datasets not viable. The value of this dataset comes from the provision of an up-to-date snapshot of current data science skills needs across the EU.	All data collected is translated into CSV format.	The Adzuna data is accessible via the Adzuna API. The Trovit data will be not available for reuse or accessible by anyone outside of the project.	Metadata is not publically available	The data will be available for use via the EDSA dashboard However it will not be available to download as this contravenes Trovit’s terms and conditions.	No	Trovit’s terms of use prohibit the use of their data. The research exception allows us to use the data but not to make it available in raw format for others to consume for commercial purposes.	Via the EDSA dashboard	In an internal JSI repository	N/A	N/A	N/A	N/A	Until the end of the project	<1Gb	ODI lead data management and curation, other WP1 partners will contribute	Backed up in an internal JSI repository	Approximately 1 day person effort per month
5	WP1	ODI	Individual results from demand analysis	IndividualResponses	Ongoing	No	Generated	Interviews and survey	584 surveys, 108 interviews at present. Online survey still open.	Internal demand analysis.	A number of surveys exist in this domain but their data is not available to this project. This data will enable EDSA to build up a country by country view of current capacity and requirements for data science skills.	Data collection methods outlined in D1.4. Translated into CSV format.	Data will be not shared or available for reuse. The data collected will be used for internal analysis to inform the creation of curriculum. Anonymised data will be publicly available.	Metadata is not publically available	Raw data will be owned by the project and unlicensed. It will not be available for reuse.	No	Data protection of personal data	Data will be not shared or available for reuse	Internal ODI repository	N/A	N/A	N/A	N/A	Until the end of the project	<100Mb	ODI lead data management and curation, other WP1 partners will contribute	Backed up to an internal ODI respository	Approximately 1 day effort per month
6	WP1	ODI	Summary data from surveys and interviews	DemandAnalysisSummary	Finished	Yes	Generated	Interviews and survey	585 surveys, 108 interviews.	External analysis of respondents who took the surveys and interviews.	None	Data collection methods outlined in D1.4. Translated into CSV format.	A README.md file is available detailing the data structure and basic usage.	https://theodi.github.io/edsa-demand-analysis-summary-data/	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	Yes	N/A	Data will be available to access from the EDSA website and the ODIs Github repository.	Github/ EDSA website	Yes	https://theodi.github.io/edsa-demand-analysis-summary-data/	https://theodi.github.io/edsa-demand-analysis-summary-data/	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	As long as Github exists as a minimum. Beyond that a value judgement would have to be made.	<100Mb	ODI lead data management and curation, other WP1 partners will contribute	Stored in external repositories - EDSA website and Github	Github free and public
7	WP1	ODI	De-identified survey responses from demand analysis	DeidentifiedResponses	Ongoing	No	Generated	Survey	496 survey results	External analysis of results and trends by anyone who wishes to gather survey data in the area of data science	There are a number of other surveys that have been aggregated that we can compare our result too and use these results if necessary. This dataset has the same eventual value to others in the area	Data collection methods outlined in D1.4. Translated into CSV format.	A README.md file is available detailing the data structure and basic usage.	http://davetaz.github.io/quantitative-data-from-edsa-demand-analysis-/	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	Yes	N/A	Data will be available to view on the EDSA dashboard and accessible for free in the EDSA dashboard Github repository.	Github/ EDSA Dashboard on website	Yes	Github/ EDSA Dashboard on website	http://davetaz.github.io/quantitative-data-from-edsa-demand-analysis-/	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	As long as Github exists as a minimum. Beyond that a value judgement would have to be made.	<100Mb	ODI lead data management and curation, other WP1 partners will contribute	Stored in external repositories - EDSA website and Github	Github free and public
8	WP1	ODI	Recordings and transcriptions of interviews	InterviewTranscipts	Finished	No	Generated	Interviews	108 transcripts, 108 recordings	Internal demand analysis only	No similar datasets exist that are usable for this project. The interviews provide insights and data points for use in the demand analysis.	Qualitative research methodology for collection outlined in D1.4	Data will be not available for reuse or accessible by anyone outside of the project. The data collected will be used for internal analysis to inform the creation of curriculum.	N/A	Raw data will be owned by the project and unlicensed. It will not be available for reuse.	No	Data protection of personal data	Data will be not shared or available for reuse. The data collected will be used for internal review to inform the creation of curriculum and will only be available publically as anonymous data	Internal ODI repository	N/A	N/A	N/A	N/A	Until the end of the project	< 3GB	ODI lead data management and curation, other WP1 partners will contribute	Backed up to an internal ODI respository	As part of the subcontracting costs of WP1
9	WP1	ODI	ideXlab search platform results	ExpertIdentification	Ongoing	No	Collected	Research publications	Final scale not yet known as collection is ongoing	Internal demand analysis and to inform curriculum development. Provides insights into offer side of skills analysis.	Not in this area. This dataset will provide validation of the demand analysis and form the basis for further insights.	The ideXlab search engine will use the sampling approach outlined in D1.2. for data collection. CSV data will be created	Data will be not available for reuse or accessible by anyone outside of the project. The data collected will be used for internal analysis to inform the creation of curriculum.	Accompanying document to explain data structure. This will not be made open.	Raw data will be owned by the project and unlicensed. It will not be available for reuse.	No	Data protection of personal data	The data will not be shared due to restrictions on the use of personal data.	ideXlab search platform	N/A	N/A	N/A	N/A	Until the end of the project	Est. 1000 returns	ideXlab lead data management and curation, other WP1 partners will contribute	Backed up to an internal ideXlab respository	Approx 2 person days per month. No other external costs
10	WP2	ODI	Related course data regarding similar modules and training offerings across the EU	DataScienceCourses	Finished	No	Collected	Course websites	600 KB	Internal use for development of curricula and learning materials. External use for identfying useful courses	None. The data will provide a useful resource for those wishing to understand what courses are available.	Systematic search and review of available data science courses. The search terms were Data Science, Big Data, Data Analytics, Business Analytics, Machine Learning, Distributed Computing, Advanced Computing Data Science Stream, Data Analytics stream.	Metadata has been published alongside the data	https://theodi.github.io/data-science-courses-in-europe-2016/	The data is licensed under a Creative Commons CC-BY 4.0 licence	Yes	N/A	GitHub/EDSA website	Github, EDSA website	Yes	https://theodi.github.io/data-science-courses-in-europe-2016/	https://theodi.github.io/data-science-courses-in-europe-2016/	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	Until the end of the project	< 1GB	ODI lead data management and curation	Backed up to an internal ODI repository	0.5 days per month
11	WP2	Persontyle	Datasets for course examples and exercises	Using namespace notation to specify R packages: sml::poly4, sml::poly4b, sml::kmeans, sml::seeds, car::Duncan, car::Davis, datasets::car, datasets::HairEyeColor, datasets::Airquality, datasets::swiss, bestGLM::zprostate, MASS::menarche	Finished	Yes	Both	Various - many from third party R packages students download from CRAN. Some in an author developed package.	12 small datasets. <1MB	Students in the "Essentials of Data Analytics and Machine Learning" course.	Third party R packages students download from CRAN. Some in an author developed package hosted on CRAN	None	The datasets will be used within learning activities offered as part of the "Essentials of Data Analytics and Machine Learning" course. They are stored in the sml R package.	Package documentation (except, currently, for those in the sml package)	GNU GPL V3, http://www.gnu.org/licenses/gpl-3.0.en.html	Yes	N/A	Via R packages, searchable online.	CRAN	Yes	CRAN, except for sml package which is currently available on the EDSA portal and will move to CRAN when finished.	https://vincentarelbundock.github.io/Rdatasets/datasets.html	GNU GPL V3, http://www.gnu.org/licenses/gpl-3.0.en.html	As long as the owners do not remove them. If the datasets are no longer accessible, other similar datasets will be used in the module.	< 1MB	Persontyle lead data management and curation, third parties for collected data	Relying on CRAN	None
12	WP2	TU/e	Event log from a municipality process	a07386a5-7be3-4367-9535-70bc9e77dbe6	Ongoing	Yes	Collected	Dutch municipality	200 KB	Users interested in real life event logs.	We have a large collection of real life event logs at http://data.3tu.nl/repository/collection:event_logs_real	Management throuh 3TU data center	Includes number of traces, events, attributes, timespan, etc.	http://data.3tu.nl/repository/uuid:a07386a5-7be3-4367-9535-70bc9e77dbe6	Non-commercial licence	No	The data is shared and publically available for non-commercial reuse. Its non-commercial licence means it cannot be published openly.	http://data.3tu.nl/repository/uuid:a07386a5-7be3-4367-9535-70bc9e77dbe6	http://data.3tu.nl/repository/uuid:a07386a5-7be3-4367-9535-70bc9e77dbe6	Yes	http://data.3tu.nl/repository/uuid:a07386a5-7be3-4367-9535-70bc9e77dbe6	http://data.3tu.nl/repository/uuid:a07386a5-7be3-4367-9535-70bc9e77dbe6	unknown	" As long as the owners do not remove them. If the datasets are no longer accessible, other similar datasets will be used in the module. "	200 KB	3TU	Reliant on third party. If the dataset becomes unavailable we will use a similar one in the online module.	none
13	WP3	JSI	Repository statistics on downloads and views of educational resources	RepositoryStatistics	Available, regularly updated	No	Collected	videolectures.net	views and comments for each videolecture	internal analysis, curriculum development, external demand analysis	None. Provides evidence of resource usage and basis for improving curriculum, content and course structure.	CSV is used for Videolectures API	Videolectures REST api documentation. An MD Readme file is available for download	https://github.com/innanoval/edsa-videolectures-statistics-dataset-1/tree/gh-pages/data	The data is licensed under a Creative Commons CC-BY 4.0 licence	Yes	N/A	Available to see at videolectures website; described as part of WP3 deliverables	videolectures repository. Proximity to data source.	Yes	JSI server	https://github.com/innanoval/edsa-videolectures-statistics-dataset-1/tree/gh-pages/data	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	the data will be available after the project ends as part of the project's learning materials	< 1GB	JSI lead data management and curation. OU contribute	videolectures - relying on internal quality assurance & back up procedures	Approximately 1 day per month during the project’s lifetime
14	WP3	OU	Learning Analytics data generated from the EDSA Online Courses portal	EDSAOnlineCoursesLA	Ongoing. Generation of data started on 01/02/2016, together with the launch of the first EDSA self-study courses	No	Generated	http://courses.edsa-project.eu	Not yet known	Course producers can get an understanding of how their courses are being used. Learners can monitor their learning progress.	Not many Learning Analytics datasets are publicly available. The OU has recently published a similar dataset: https://analyse.kmi.open.ac.uk/open_dataset	The xAPI specification is used for expressing the data; the open source Learning Locker software is used for storing and visualising the data.	Introduction to the xAPI (or Tin Can API): https://tincanapi.com/overview/. Introduction to Learning Locker: https://learninglocker.net	https://tincanapi.com/overview/ https://learninglocker.net https://alexmikro.github.io/learning-analytics-dataset-from-the-edsa-online-courses-portal/	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	Yes	N/A	Via the EDSA website / Github	We have setup a dedicated EDSA Learning Locker. This was chosen for the reasons outlined in https://learninglocker.net/benefits/	Yes	EDSA Learning Locker	https://alexmikro.github.io/learning-analytics-dataset-from-the-edsa-online-courses-portal/	CC-BY	At least until the end of project	Not yet known	OU lead data management and curation.	Relying on the backup procedures of the OU, as the dataset is hosted on an OU server.	Server storage has already been purchased. Effort for analysing the data has been allocated in Task 3.4.
15	WP3	JSI	Internal logs of elearning systems	InternalLogs	Available, regularly updated	No	Collected	videolectures.net	for videolectures: 20.000 videos, 17.431 lectures, 12.998 authors, 952 events, 579 categories	internal demand analysis	None. Provides evidence of resource usage and basis for improving curriculum, content and course structure.	JSON is used for Videolectures API	Videolectures REST api documentation	N/A	Raw data will be owned by the project and unlicensed. It will not be available for reuse.	No	Privacy. Data requires anonymisation and/or aggregation, and at the moment the use case for anonymised data is not clear.	Available to see at videolectures website; described as part of WP3 deliverables	videolectures repository. Proximity to data source.	N/A	JSI server	N/A	N/A	at least until the end of project	N/A	JSI lead data management and curation. OU contribute	videolectures - relying on internal quality assurance & back up procedures	N/A
16	WP3	JSI	Statistics of course registration, participation and completion	StatisticsForCourses	Available, regularly updated	No	Collected	videolectures.net	for videolectures - available per videolecture, per viewer	internal demand analysis	None. Provides basis for improving curriculum, content and course structure.	JSON is used for Videolectures API	Videolectures REST api documentation	N/A	Raw data will be owned by the project and unlicensed. It will not be available for reuse.	No	Privacy. Data that does not contain privacy issues might be publishable	Available to see at videolectures website; described as part of WP3 deliverables	videolectures repository. Proximity to data source.	N/A	JSI server	N/A	N/A	at least until the end of project	< 1GB	JSI lead data management and curation. OU contribute	videolectures - relying on internal quality assurance & back up procedures	N/A
17	WP3	JSI	Aggregated statistics of engagement with the developed courses and educational resources	AggregatedStatistics	Available, regularly updated	Np	Generated	videolectures.net	for videolectures - available per videolecture, per viewer	internal demand analysis	None. Provides evidence of adoption and basis for improving curriculum, content and course structure.	JSON is used for Videolectures API	Videolectures REST api documentation	N/A	Raw data will be owned by the project and unlicensed. It will not be available for reuse.	No	Privacy. Data that does not contain privacy issues might be publishable	Available to see at videolectures website; described as part of WP3 deliverables	videolectures repository. Proximity to data source.	N/A	JSI server	N/A	N/A	at least until the end of project	< 1GB	JSI lead data management and curation. OU contribute	videolectures - relying on internal quality assurance & back up procedures	N/A
18	WP3	TU/e	Recorded behavior of students following the first session of the process mining MOOC	CourseraMOOCprocmin001	Ongoing	Yes	collected	coursera.org	several large tables	learning analytics within EDSA	every Coursera course has this data recorded	Data collection is managed by Coursera	There is no external link to the metadata	N/A	Raw data is owned by TU/e and cannot be shared due to Coursera restrictions of use.	No	Restrictions of use from the data provider	N/A	The data is collected by and stored on a Coursera repository.	No	Coursera	N/A	N/A	N/A	around 1 GB	Joos Buijs, Tu/e lead data management and curation	relying on coursera	N/A
19	WP4	SOTON	Web server logs and Google analytics of project website access	WebsiteAnalytics	Ongoing	No	Collected	http://edsa-project.eu	1 website	Internal analysis for dissemination and community analysis. Secondary use for implicit demand analysis.	None. Provides evidence of engagement and basis for UX improvement.	Quantitative recording of website traffic via Google Analytics dashboard, analysed using a variety of analytic tools.	Sessions, Page views, Demographics, User Flow, Bounce rate,	There is no external link to the metadata	Raw data will be owned by the project and unlicensed. It will not be available for reuse.	No	User privacy. The data can be aggregated and published under an open license	Analysed data will be made available throughout deliverable reports in WP4.	Internal institutional Soton/OU repositories	N/A	https://analytics.google.com/	N/A	N/A	at least until the end of project	< 1GB	OU lead data management and curation. Soton contribute	Backed up remotely	Free storage. 0.5 day per month
20	WP4	SOTON	Generated social media engagement data	SocialMediaEngagements	Ongoing	No	Collected	Twitter	1 Twitter Account	Internal analysis for community strength and project dissemination.	None that relate to EDSA. Provides evidence for engagement with project, effectiveness of dissemeniation activities. Provides basis for understanding what content users find most engaging.	Regular access of data from analytics.twitter.com	Tweets, Impressions, Profile Visits, Followers, Mentions	https://analytics.twitter.com/user/edsa_project/home	Data will be licensed in compliance with each social network's terms and conditions	No	Data sharing needs to comply with individual site licenses. However the majority of social networks do not permitted collection, harvesting and republication of data	Dashboard on EDSA website. Deliverable reports in WP4.	Internal institutional Soton repositories		Data not accessible directly without tools. Required Twitter harvester.			Until the end of the project	< 1GB	Soton lead data management and curation.	Backed up remotely	Free storage. 1 day per month
21	WP5	ideXlab	List of project exploitation results – collaborations, institutional and geographical beneficiaries,	ProjectExploitation	Ongoing	No	Generated	Project partners	Variable	Internal analysis for results to be exploited and targets	None. Provides data on dissemination activity, network and results.	Report detailing results from interviews and exploitation activities	N/A	N/A	Raw data will be owned by the project and unlicensed. It will not be available for reuse.	No	Confidentiality	Deliverable reports in WP5.	Google docs shared document	N/A		N/A	N/A	Until the end of the project	< 500MB	ideXlab lead data management curation	Backed up remotely	Free storage. 1 day per month
22	WP5	ODI	The EDSA Register	EDSARegister	Ongoing	Yes	Generated	Project partners	<500KB	Anyone interested in understanding the datasets used within the EDSA project. Internal management tool.	None	Project partners update every three months until the end of the project. ODI responsible for conversion to CSV and publication as open data.	A README.md file is available detailing the data structure and basic usage.	https://theodi.github.io/european-data-science-academy-register/	This dataset is published on Github, under a CC-BY licence.	Yes	N/A	Via Github and via the EDSA website (http://edsa-project.eu/resources/datasets/)	Google docs shared document and Github	Yes	https://theodi.github.io/european-data-science-academy-register/	https://theodi.github.io/european-data-science-academy-register/	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	As long as Github exists as a minimum. Beyond that a value judgement would have to be made.	< 500MB	ODI lead data management and curation, other WP1 partners will contribute	Stored in external repositories - EDSA website and Github	Stored in external repositories - EDSA website and Github; approximately 2 days per month effort for maintenance.


1	Category	Field	Description
2	Dataset Reference and Name	Work Package	Work package in which the dataset was used or produced
3	Dataset Reference and Name	Organisation	Organisation responsible for collecting or using the data
4	Dataset Reference and Name	Dataset Title	Title of the dataset
5	Dataset Reference and Name	Dataset Identifier	Unique identifier for the dataset
6	Dataset Reference and Name	Status - January 2017 (ongoing, in progress, due date)
7	Dataset Reference and Name	New entry to data management plan? Yes/No
8	Data set description	Generated or collected	Whether the dataset was Collected (e.g. by harvesting) or Generated (e.g. by analysing another dataset)
9	Data set description	Origin (if collected)	Name of service or other data sources
10	Data set description	Scale	Description of size and content of dataset
11	Data set description	Who is this useful for?
12	Data set description	Similar existing dataset and possibility for integration? Value of this new dataset?
13	Standards	What standards and methodologies will be utilised for data collection and management?
14	Standards	Outline the metadata, documentation or other supporting material that should accompany the data for it to be interpreted correctly
15	Standards	Status and location of metadata, documentation or other supporting material
16	Data sharing	Licensing, data protection, ownership and copyright	Notes on the copyright, rights and ownership of the dataset
17	Data sharing	Can the data be published under an open licence?	Indicates whether the data can be openly published (Yes, No, Maybe)
18	Data sharing	Reasons why the data cannot be shared	Description of why a dataset cannot or might not be suitable for openly published
19	Data sharing	How will the data be shared? (including access procedures, dissemination, software/tools needed for enabling reuse	Notes on how the data might be shared with others
20	Data sharing	Which repository will be used for the data? Why this respository?	The platform or repository used to host the data, and why it was selected
21	Data sharing	Is it ready to be published?	Indicates whether the data is ready for publication (Yes, No, N/A if not suitable for publishing)
22	Data sharing	Current location of dataset	The current location of the data, e.g. the name of a platform or service
23	Data sharing	Dataset Link	This should be a link to the actual, downloadable dataset for any openly published data. N/A if data cannot be published
24	Data sharing	Licence	The licence applies to any openly published data. N/A if data cannot be openly published
25	Archiving and preservation	How long should the data be preserved? How will it exceed the length of the project if necessary?
26	Archiving and preservation	Approx end volume
27	Archiving and preservation	Who is responsible in your organisation for the data managament and curation?
28	Archiving and preservation	Quality assurance and back up procedures?
29	Archiving and preservation	Associated costs and how these will be covered - do you need to purchase storage? How much time will it take for a person to manage the data - how will this be covered?
30	Data Ethics	Are there any ethical or legal issues that can have an impact on sharing this data? Y/N
31	Data Ethics	What are the ethical or legal issues that can occur from sharing this data?


1	Field	Code	Description
2	Work Package	WP1	Work package 1 – Demand analysis and advisory board
3	Work Package	WP2	Work package 2 – Curricula and course development
4	Work Package	WP3	Work package 3 – Training delivery and learning analytics feedback
5	Work Package	WP4	Work package 4 – Dissemination and community building
6	Work Package	WP5	Work package 5 – Exploitation
7	Organisation	ODI	Open Data Institute
8	Organisation	OU	Open University
9	Organisation	JSI	Jožef Stefan Institute
10	Organisation	SOTON	University of Southampton
11	Organisation	ideXlab	ideXlab
12	Organisation	TU/e	Eindhoven University of Technology


1					Data set reference and name	Data set description					Standards		Data sharing				Archiving and preservation
2				Timeline - ongoing, in progress, due date	Identifier for the data set produced	Generated or collected	Origin (if collected)	Scale	Who is this useful for?	Similar existing dataset and possibility for integration? Value of this new dataset?	What standards and methodologies will be utilised for data collection and management?	Outline the metadata, documentation or other supporting material that should accompany the data for it to be interpreted correctly	Licensing, data protection, ownership and copyright	How will the data be shared? (including access procedures, dissemination, software/tools needed for enabling reuse	Repository for the data. Why this respository?	If the data cannot be shared - why?	How long should the data be preserved? How will it exceed the length of the project if necessary?	Approx end volume	Who is responsible in your organisation for the data managament and curation?	Quality assurance and back up procedures?	Associated costs and how these will be covered - do you need to purchase storage? How much time will it take for a person to manage the data - how will this be covered?

3	WP1	ODI	Corpora of crawled web-based adverts from LinkedIn	Ongoing	WebSiteHarvest	Collected	LinkedIn	46 terms 31 languages 47 countries 1 harvest per day 2162 data points per day	Internal demand analysis. External research into job and skill demand	Many datasets are collected in this area, however due to the specific nature of the question, collection a fresh is just as easy and reliable. Wider value is only relevant if you are also doing a data science study with the same methodology.	All data collected is translated into CSV format.	A README.md file is available detailing the data structure and basic usage.	CC-BY 4.0	Data will be visiable via the dashboard and available openly and for free in the dashboard Github repository.	Using Github so that the data stays close to its usage and can be used quickly and easily.	N/A	As long as Github exists as a minimum. Beyond that a value judgement would have to be made.	<1Gb	Everyone	No-one we store everything with external providers, e.g. Github	Github free and public
4			Aggregated statistics of European skill demand based on web-based job adverts	Ongoing	WebSiteStatistics	Generated	LinkedIn	TBC - end of June	Internal demand analysis. External research into job and skill demand	as above	as above	as above	CC-BY 4.0	Data will be made available to view online on the EDSA dashboard, Where possible open data will be provided so that users are able to access the raw data themselves and look at the findings of the project.	Github/ EDSA Dashboard on website	N/A	N/A	<1Gb	Everyone	No-one we store everything with external providers, e.g. Github	Github free and public
5			Individual results from online survey	Ongoing	OnlineResponses	Collected	Individuals	End of M18	Internal demand analysis. External research into job and skill demand	N/A	JSON	as above	Not available	Not shared due to data protection	Internal ODI repository	Data protection of personal data	Until the end of the project	<100Mb	Project team	Project team	As part of the subcontracting costs of WP1
6			Aggregated results from online survey	Ongoing	OnlineResponsesStatistics	Generated	Individuals	End of M18	External analysis of results and trends by anyone who wishes to gather survey data in the area of data science	There are a number of other surveys that have been aggregated that we can compare our result too and use these results if necessary. This dataset has the same eventual value to others in the area	CSV/JSON	as above	CC-BY 4.0	Publically and freely available via the projects GitHub repository	Github/ EDSA Dashboard on website	N/A	As long as Github exists as a minimum. Beyond that a value judgement would have to be made.	<100Mb	Everyone	No-one we store everything with external providers, e.g. Github	Github free and public
7			Recordings/transcriptions of interviews	Ongoing	N/A	Collected	Interviews	Approx 30	Internal analysis only	N/A	Qualitative research methodology for collection outlined in D1.1	N/A	Particpants are asked if they are happy for their interview to be recorded for us within the bounds of the project only. All data will result in anonymised, aggregated data only and will not be able to be used to identify individuals.	Raw data will not publically be available. The data collected will be used for internal review to inform the creation of curriculum and will only be available publically as anonymous aggragated data	Internal ODI repository	Privacy	Until the end of the project	Approx 30 recordings, transcriptions and summaries	ODI	Backed up to an internal ODI respoisitory	As part of the subcontracting costs of WP1
8			Aggregated statistics of ideXlab search platform results	Sample end of June, ongoing after M6	expertIdentification	Collected	Publications	TBC - end of June after implementation of application	Internal analysis, and curriculum development, external users of the demand analysis dashboard	Not in this area	Sampling approach outlined in D1.2. CSV data	N/A	Not available	Aggregated data will be available via the EDSA dashboard	ideXlab search platform	Privacy	Until the end of the project	Est. 1000 returns	ideXlab	Backed up to an internal ideXlab respository	Approx 2 person days per month. No other external costs
9	WP2	OU	Linked open data sources, such as DBLP and GeoNames	Ongoing	N/A	Collected	DBLP, GeoNames, etc	Ongoing	Users of the project's curricula and learning materials (learners, educators, trainers, etc)	N/A	Systematic search and review of available datasets	The datasets will be used within learning activities offered as part of the project's learning materials	Creative Commons licenses	Will be made available via the interactive elements of the project's learning materials	DBLP, GeoNames, etc	N/A	The data will be available after the project ends as part of the project's learning materials	< 1GB	WP2 partners	Relying on the procedures of the external datasets providers.	Approx 2 person days per month for collecting the data
10			Publically available governmental, financial, network and environmental datasets for each course.	Ongoing	N/A	Collected	Data.gov.uk, www.data.gov, etc	Ongoing	Users of the project's curricula and learning materials (learners, educators, trainers, etc)	N/A	Systematic search and review of available datasets	The datasets will be used within learning activities offered as part of the project's learning materials	Creative Commons licenses	Will be made available via the interactive elements of the project's learning materials	Data.gov.uk, www.data.gov, etc	N/A	The data will be available after the project ends as part of the project's learning materials	< 1GB	WP2 partners	Relying on the procedures of the external datasets providers.	Approx 2 person days per month for collecting the data
11			Related course data regarding similar modules and training offerings across the EU	Ongoing	DataScienceCourses	Collected	Course websites	TBC	Internal use for development of curricula and learning materials	N/A	Systematic search and review of available courses	Links to other coursers etc.	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	EDSA Website	Internal Soton repository, EDSA dashboard	N/A	Until the end of the project	< 1GB	Soton	Backed up remotely, hosted on Google Docs	0.5 days per month
12			Subsets derived from the existing data repositories produced for exercises in the learning resources	Ongoing	EDSAExercisesDatasets	Generated	N/A	Ongoing	Users of the project's curricula and learning materials (learners, educators, trainers, etc)	N/A	Building on top of existing datasets for the purposes of the EDSA exercises	The datasets will be used within learning activities offered as part of the project's learning materials	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	Will be made available via the interactive elements of the project's learning materials	N/A	N/A	The data will be available after the project ends as part of the project's learning materials	< 500MB	WP2 partners	Backed up remotely, hosted on Google Docs	Approx 2 person days per month for generating the data
13	WP3	JSI	Repository statistics on downloads and views of educational resources	for videolectures - available through api	Statistics	Collected	videolectures	views and comments for each videolecture	internnal analysis, curriculum development, external demand analysis	N/A	JSON is used for Videolectures API; answers to some general, legal and technical questions are provided by this link: http://videolectures.net/faq/	Videolectures REST api documentation	for videolectures: answers to some general, legal and technical questions are provided by this link: http://videolectures.net/faq/	this statistics is possible to see at videolectures website; described as part of WP3 deliverables	videolectures repository	N/A	the data will be available after the project ends as part of the project's learning materials	< 1GB	JSI(videolectures)/OU	videolectures - relying on internal quality assurance & back up procedures	N/A
14			Internal logs of elearning systems	for videolectures - available through api	InternalLogs	Collected	videolectures	for videolectures: 20.000 videos, 17.431 lectures, 12.998 authors, 952 events, 579 categories	internnal analysis, demand analysis	N/A	JSON is used for Videolectures API	Videolectures REST api documentation	N/A	described as part of WP3 deliverables	videolectures repository	Privacy	at least until the end of project	N/A	JSI(videolectures)/OU	videolectures - relying on internal quality assurance & back up procedures	N/A
15			Statistics of course registration, participation and completion	for videolectures - ongoing	Statistics	Collected	videolectures	ongoing	internnal analysis, demand analysis	N/A	JSON is used for Videolectures API	Videolectures REST api documentation	N/A	described as part of WP3 deliverables	videolectures repository	N/A	at least until the end of project	< 1GB	JSI(videolectures)/OU	videolectures - relying on internal quality assurance & back up procedures	N/A
16			Aggregated statistics of engagement with the developed courses and educational resources	for videolectures - ongoing	AggregatedStatistics	Generated	videolectures	ongoing	internnal analysis, demand analysis	N/A	JSON is used for Videolectures API	Videolectures REST api documentation	N/A	described as part of WP3 deliverables	videolectures repository	N/A	at least until the end of project	< 1GB	JSI(videolectures)/OU	videolectures - relying on internal quality assurance & back up procedures	N/A
17	WP4	SOTON	Web server logs and Google analytics of project website access	Ongoing	WebsiteAnalytics	Collected	http://edsa-project.eu	1 website	Internal analysis for dissemination and community analysis. Secondary use for implicit demand analysis.	N/A	Quantitative recording of website traffic	Description of metric terms	Raw data will be owned by the project and unlicensed.	Analysed data will be made available throughout deliverable reports in WP4.	Internal Soton/OU repositories		N/A	< 1GB	OU / Soton	Backed up remotely	Free storage. 0.5 day per month
18			Generated social media engagement data	Ongoing	SocialMediaEngagements	Collected	Twitter, LinkedIn,	1 Twitter Account; Up to 30 LinkedIn Community Groups	Internal analysis for community strength and project dissemination.	N/A	Regular access of data from analytics.twitter.com	Descriptions of data attributes	Licensed in compliance with each social network's terms.	Dashboard on EDSA website. Deliverable reports in WP4.	Internal Soton repositories		Until the end of the project	< 1GB	Soton	Backed up remotely	Free storage. 1 day per month
19			Aggregated statistics of networking and engagement data	Ongoing	EngagementReports	Generated		Variable	Internal analysis for dissemination and community building.	N/A	Quantiative analysis of engagement data	Who attended each event, what type of presentation or activity was taken, where was the event.	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	Deliverable reports in WP4.	EDSA Dashboard		Until the end of the project	< 500MB	Soton	Backed up remotely	Free storage. 2 days per month
20			Learning materials access data	Ongoing	LearningMaterialAccess	Collected	Various: MOOCs (Futurelearn, Coursera), project website, iBook Store	Variable	Internal analysis for dissemination and engagement with learning materials	Repository statistics on downloads and views of educational resources, and Statistics of course registration, participation and completion from WP3	Quantiative recording of web server logs and page views	Description of terms	Creative Commons Attribution (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/	Deliverable reports in WP4. Dashboard on EDSA website.	EDSA Dashboard		Until the end of the project	< 1GB	OU / Soton	Backed up remotely	1 day per month
21	WP5	ideXlab	List of project exploitation results – collaborations, institutional and geographical beneficiaries,	Ongoing	ProjectExploitation	Generated	Project partners	Variable	Internal analysis for results to be exploited and targets	N/A	Results from interviews and exploitation activities	N/A	Not available	Deliverable reports in WP5.	Google docs shared document	Confidentiality	Until the end of the project	< 500MB	ideXlab	Backed up remotely	Free storage. 1 day per month