| A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | AA | AB | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Key as used in metadata concept | |||||||||||||||||||||||||||
2 | applies to each… | link at frictionlessdata.io | OPSD 1.2 | wanted for OPSD? | example value (OPSD Time series) | explanation | ||||||||||||||||||||||
3 | Data Package | https://frictionlessdata.io/specs/data-package#name | name | yes | opsd_time_series | A short url-usable (and preferably human-readable) name of the package. This MUST be lower-case and contain only alphanumeric characters along with ".", "_" or "-" characters. It will function as a unique identifier and therefore SHOULD be unique in relation to any registry in which this package will be deposited (and preferably globally unique). The name SHOULD be invariant, meaning that it SHOULD NOT change when a data package is updated, unless the new package version should be considered a distinct package, e.g. due to significant changes in structure or interpretation. Version distinction SHOULD be left to the version property. As a corollary, the name also SHOULD NOT include an indication of time range covered. | ||||||||||||||||||||||
4 | Data Package | https://frictionlessdata.io/specs/data-package#id | id | yes | A property reserved for globally unique identifiers. Examples of identifiers that are unique include UUIDs and DOIs. A common usage pattern for Data Packages is as a packaging format within the bounds of a system or platform. In these cases, a unique identifier for a package is desired for common data handling workflows, such as updating an existing package. While at the level of the specification, global uniqueness cannot be validated, consumers using the id property MUST ensure identifiers are globally unique. | |||||||||||||||||||||||
9 | Data Package | https://frictionlessdata.io/specs/data-package#profile | profile | yes | tabular-data-package | Different kinds of data need different data and metadata formats. To support these different data and metadata formats we need to extend and specialise the generic Data Package. These specialized types of Data Package (or Data Resource) are termed profiles. For example, there is a Tabular Data Package profile that specializes Data Packages specifically for tabular data. Thus, every Package and Resource descriptor has a profile. The namespace for the profile is the type of descriptor, so the default profile, if none is declared, is data-package for a Package descriptor and data-resource for a Resource descriptor. In summary, an extension of Data Package may be formalised as a profile. A profile is a Data Package which extends the default specification towards more specific needs. | ||||||||||||||||||||||
10 | Data Package | https://frictionlessdata.io/specs/data-package#licenses | licenses | optional | The license(s) under which the package is provided. This property is not legally binding and does not guarantee the package is licensed under the terms defined in this property. | |||||||||||||||||||||||
11 | Data Package | https://frictionlessdata.io/specs/data-package#licenses | license/name | optional | cc-by-nc-4.0 | The name MUST be an Open Definition license ID | ||||||||||||||||||||||
12 | Data Package | https://frictionlessdata.io/specs/data-package#licenses | license/path | optional | https://creativecommons.org/licenses/by-nc/4.0/ | A url-or-path string, that is a fully qualified HTTP address, or a relative POSIX path (see the url-or-path definition in Data Resource for details). | ||||||||||||||||||||||
13 | Data Package | https://frictionlessdata.io/specs/data-package#licenses | license/title | optional | Creative Commons Attribution-NonCommercial 4.0 | A human-readable title | ||||||||||||||||||||||
14 | Data Package | license/instruction | optional | |||||||||||||||||||||||||
15 | Data Package | attribution | yes | Attribution should be given as follows:<ul style=\"margin-bottom: 0;\"><li style=\"margin-bottom: 0;\">For academic and professional use (presentations, journal articles, trade publications, etc): Please cite the papers describing our methods [1, 2] and, if possible, link to www.renewables.ninja.<li style=\"margin-bottom: 0;\">For other use: Please either cite the papers [1, 2] or link to www.renewables.ninja, as is more appropriate.</ul>[1] Pfenninger, Stefan and Staffell, Iain (2016). Long-term patterns of European PV output using 30 years of validated hourly reanalysis and satellite data. Energy 114, pp. 1251-1265. doi: 10.1016/j.energy.2016.08.060<br>[2] Staffell, Iain and Pfenninger, Stefan (2016). Using Bias-Corrected Reanalysis to Simulate Current and Future Wind Power Output. Energy 114, pp. 1224-1239. doi: 10.1016/j.energy.2016.08.068 | How this datapackage should be cited | |||||||||||||||||||||||
16 | Data Package | https://frictionlessdata.io/specs/data-package#title | title | yes | Time series | A string providing a title or one sentence description for this package | ||||||||||||||||||||||
17 | Data Package | https://frictionlessdata.io/specs/data-package#description | description | yes | load, wind and solar, prices in hourly resolution | a description of the package. The description MUST be markdown formatted -- this also allows for simple plain text as plain text is itself valid markdown. The first paragraph (up to the first double line break) should be usable as summary information for the package. | ||||||||||||||||||||||
19 | Data Package | https://frictionlessdata.io/specs/data-package#homepage | homepage | yes | https://data.open-power-system-data.org/time_series/2018-03-13/ | A URL for the home on the web that is related to this data package. | ||||||||||||||||||||||
20 | Data Package | https://frictionlessdata.io/specs/data-package#version | version | yes | 2018-03-13 | a version string identifying the version of the package. It should conform to the Semantic Versioning requirements and should follow the Data Package Version pattern. | ||||||||||||||||||||||
21 | Data Package | https://frictionlessdata.io/specs/data-package#sources | sources | yes | The raw sources for this data package. It MUST be an array of Source objects. Each Source object MUST have a title and MAY have path and/or email properties. | |||||||||||||||||||||||
22 | Data Package | https://frictionlessdata.io/specs/data-package#sources | source/title | yes | Amprion | title of the source (e.g. document or organization name) | ||||||||||||||||||||||
23 | Data Package | https://frictionlessdata.io/specs/data-package#sources | source/path | yes | http://www.amprion.net/en/photovoltaic-infeed | A url-or-path string, that is a fully qualified HTTP address, or a relative POSIX path | ||||||||||||||||||||||
25 | Data Package | source/description | optional | |||||||||||||||||||||||||
26 | Data Package | source/license | optional | |||||||||||||||||||||||||
27 | Data Package | source/copyright | optional | Who holds copyright on the data source | ||||||||||||||||||||||||
28 | Data Package | https://frictionlessdata.io/specs/data-package#contributors | contributors | yes | The people or organizations who contributed to this Data Package. It MUST be an array. Each entry is a Contributor and MUST be an object. A Contributor MUST have a title property and MAY contain path, email, role and organization properties. An example of the object structure is as follows: | |||||||||||||||||||||||
29 | Data Package | https://frictionlessdata.io/specs/data-package#contributors | contributor/title | yes | Jonathan Mühlenpfordt | name/title of the contributor (name for person, name/title of organization) | ||||||||||||||||||||||
30 | Data Package | https://frictionlessdata.io/specs/data-package#contributors | contributor/path | yes | http://neon-energie.de/en/team/ | a fully qualified http URL pointing to a relevant location online for the contributor | ||||||||||||||||||||||
31 | Data Package | https://frictionlessdata.io/specs/data-package#contributors | contributor/email | yes | muehlenpfordt@neon-energie.de | An email address | ||||||||||||||||||||||
32 | Data Package | https://frictionlessdata.io/specs/data-package#contributors | contributor/role | yes, allows mentioning historical contributors | author | A string describing the role of the contributor. It MUST be one of: author, publisher, maintainer, wrangler, and contributor. Defaults to contributor. Note on semantics: use of the "author" property does not imply that that person was the original creator of the data in the data package - merely that they created and/or maintain the data package. It is common for data packages to "package" up data from elsewhere. The original origin of the data can be indicated with the sources property - see above. | ||||||||||||||||||||||
33 | Data Package | https://frictionlessdata.io/specs/data-package#contributors | contributor/organization | yes | Neon GmbH | A string describing the organization this contributor is affiliated to. | ||||||||||||||||||||||
39 | Data Package | lastChanges | yes | Include data for 2017 where available from primary sources and include hourly load from ENTSO-E Power Statistics | What has changed about the data since the last version | |||||||||||||||||||||||
40 | Data Package | https://frictionlessdata.io/specs/data-package#keywords | keywords | yes | time series, power systems, ... | An Array of string keywords to assist users searching for the package in catalogs. | ||||||||||||||||||||||
42 | Data Package | https://frictionlessdata.io/specs/data-package#created | created | optional | 2018-03-03T12:53:10Z | The datetime on which this data package was created. Note: semantics may vary between publishers -- for some this is the datetime the data was created, for others the datetime the package was created. The datetime must conform to the string formats for datetime as described in RFC3339 | ||||||||||||||||||||||
43 | Data Package | publicationDate | yes | same as version | ||||||||||||||||||||||||
44 | Data Package | longDescription | yes | This data package contains different kinds of timeseries data relevant for power system modelling, namely electricity consumption (load) for 37 European countries as well as wind and solar power generation and capacities and prices for a growing subset of countries. The timeseries become available at different points in time depending on the sources. The data has been downloaded from the sources, resampled and merged in a large CSV file with hourly resolution. Additionally, the data available at a higher resolution (Some renewables in-feed, 15 minutes) is provided in a separate file. All data processing is conducted in python and pandas and has been documented in the Jupyter notebooks linked below. | Our full description for this data package | |||||||||||||||||||||||
45 | Data Package | documentation | yes | https://github.com/Open-Power-System-Data/datapackage_timeseries/blob/2018-03-13/main.ipynb | Link to main-script on github | |||||||||||||||||||||||
46 | Data Package | spatial | yes | |||||||||||||||||||||||||
47 | Data Package | spatial/location | yes | 37 European countries | Which countries are covered | |||||||||||||||||||||||
49 | Data Package | spatial/resolution | yes | countries | countries , bidding zones, control areas, individual plants, or a mix of these | |||||||||||||||||||||||
50 | Data Package | _external | yes | false | Indicate whether this data package comes from the "OPSD" core teams or is a contributed data package | |||||||||||||||||||||||
51 | Data Package | https://frictionlessdata.io/specs/data-package/#descriptor | temporal | yes | Which time period is covered | |||||||||||||||||||||||
52 | Data Package | https://frictionlessdata.io/specs/data-package#descriptor | temporal/start | yes for time series | 2012-01-01 | start of the time period covered | ||||||||||||||||||||||
53 | Data Package | https://frictionlessdata.io/specs/data-package#descriptor | temporal/end | yes for time series | 2017-12-31 | end of the time period covered | ||||||||||||||||||||||
54 | Data Package | temporal/referenceDate | yes for power plants | 2017-12-31 | ||||||||||||||||||||||||
55 | Data Package | temporal/resolution | yes for time series | 15 Minutes | ||||||||||||||||||||||||
59 | Data Package | _comment | optional | |||||||||||||||||||||||||
60 | Data Package | _metadataVersion | yes | 1.2 | ||||||||||||||||||||||||
82 | Data Package | resources | yes | The Data Resource format describes a data resource such as an individual file or table. | ||||||||||||||||||||||||
83 | Data Resource (file) | https://frictionlessdata.io/specs/data-resource#name | resource/name | yes | opsd_time_series_15min | A resource MUST contain a name property. The name is a simple name or identifier to be used for this resource. If present, the name MUST be unique amongst all resources in this data package. It MUST consist only of lowercase alphanumeric characters plus ".", "-" and "_". It would be usual for the name to correspond to the file name (minus the extension) of the data file the resource describes. | ||||||||||||||||||||||
84 | Data Resource (file) | https://frictionlessdata.io/specs/data-resource#profile | resource/profile | yes | tabular-data-resource | A string identifying the profile of this descriptor as per the profiles specification. | ||||||||||||||||||||||
85 | Data Resource (file) | https://frictionlessdata.io/specs/data-resource#path | resource/path | yes | timeseries15.csv | MUST be a string -- or an array of strings (see "Data in Multiple Files"). Each string MUST be a "url-or-path" as defined in the next section. A "url-or-path" is a string with the following additional constraints: - MUST either be a URL or a POSIX path - URLs MUST be fully qualified. MUST be using either http or https scheme. (Absence of a scheme indicates MUST be a POSIX path) - POSIX paths (unix-style with / as separator) are supported for referencing local files, with the security restraint that they MUST be relative siblings or children of the descriptor. Absolute paths (/) and relative parent paths (../) MUST NOT be used, and implementations SHOULD NOT support these path types. | ||||||||||||||||||||||
86 | Data Resource (file) | https://frictionlessdata.io/specs/data-resource#optional-properties | resource/title | yes | Time series 15 minutes singleindex | a title or label for the resource. | ||||||||||||||||||||||
87 | Data Resource (file) | https://frictionlessdata.io/specs/data-resource#optional-properties | resource/description | optional | All time series which are available in 15 minute resolution in singleindex format | a description of the resource. | ||||||||||||||||||||||
88 | Data Resource (file) | https://frictionlessdata.io/specs/data-resource/#optional-properties | resource/format | yes | csv | 'csv', 'xls', 'json' etc. Would be expected to be the standard file extension for this type of resource. | ||||||||||||||||||||||
89 | Data Resource (file) | https://frictionlessdata.io/specs/data-resource#optional-properties | resource/mediatype | yes | text/csv | the mediatype/mimetype of the resource e.g. 'text/csv', 'application/vnd.ms-excel' | ||||||||||||||||||||||
90 | Data Resource (file) | https://frictionlessdata.io/specs/data-resource/#optional-properties | resource/encoding | yes | UTF8 | specify the character encoding of the resource's data file. The values should be one of the "Preferred MIME Names" for a character encoding registered with IANA. If no value for this key is specified then the default is UTF-8. | ||||||||||||||||||||||
91 | Data Resource (file) | https://frictionlessdata.io/specs/data-resource#optional-properties | resource/bytes | yes | 137427339 | size of the file in bytes | ||||||||||||||||||||||
92 | Data Resource (file) | https://frictionlessdata.io/specs/data-resource#optional-properties | resource/hash | yes | 66b8dc30a3ffd8b675bb8d9ba8f1e25934b75a9e6df9402998917a9c2c3b7495 | the MD5 hash for this resource. Other algorithms can be indicated by prefixing the hash's value with the algorithm name in lower-case. For example | ||||||||||||||||||||||
93 | Data Resource (file) | https://frictionlessdata.io/specs/tabular-data-resource#csv-dialect | resource/dialect | yes | CSV Dialect defines a simple format to describe the various dialects of CSV files in a language agnostic manner. It aims to deal with a reasonably large subset of the features which differ between dialects, such as terminator strings, quoting rules, escape rules and so on. | |||||||||||||||||||||||
94 | Data Resource (file) | https://frictionlessdata.io/specs/csv-dialect#specification | resource/dialect/delimiter | yes | , | specifies the character sequence which should separate fields (aka columns). Default = ,. Example \t. | ||||||||||||||||||||||
95 | Data Resource (file) | resource/dialect/decimalChar | yes | |||||||||||||||||||||||||
96 | Data Resource (file) | https://frictionlessdata.io/specs/csv-dialect#specification | resource/dialect/lineTerminator | yes | \n | specifies the character sequence which should terminate rows. Default = \r\n | ||||||||||||||||||||||
102 | Data Resource (file) | https://frictionlessdata.io/specs/csv-dialect#specification | resource/dialect/header | yes | true | indicates whether the file includes a header row. If true the first row in the file is a header row, not data. Default = true | ||||||||||||||||||||||
105 | Data Resource (file) | resource/_alternative_formats | optional | List of files with same content in alternative formatting (i.e. multiindex, stacked) | ||||||||||||||||||||||||
106 | Data Resource (file) | resource/_alternativeFormats/path | optional | time_series15_multiindex.csv | Filename of the resource in the alternative format | |||||||||||||||||||||||
107 | Data Resource (file) | resource/_alternativeFormats/stacking | optional | Multiindex | name of the format of the resource in the alternative format | |||||||||||||||||||||||
108 | Data Resource (file) | resource/_alternativeFormats/format | optional | csv | file extension of the resource in the alternative format | |||||||||||||||||||||||
109 | Data Resource (file) | resource/_group | optional | Indicate a group to which this file belongs to display them together | ||||||||||||||||||||||||
112 | Data Resource (file) | https://frictionlessdata.io/specs/tabular-data-resource/ | resource/schema | yes | The value for the schema property on a resource MUST be an object representing the schema OR a string that identifies the location of the schema. If a string it must be a url-or-path as defined above, that is a fully qualified http URL or a relative POSIX path. The file at the location specified by this url-or-path string MUST be a JSON document containing the schema Table Schema is a simple language- and implementation-agnostic way to declare a schema for tabular data. Table Schema is well suited for use cases around handling and validating tabular data in text formats such as CSV, but its utility extends well beyond this core usage, towards a range of applications where data benefits from a portable schema format. | |||||||||||||||||||||||
113 | Data Resource (file) | https://frictionlessdata.io/specs/table-schema#missing-values | resource/schema/missingValues | yes | "" | dictates which string values should be treated as null values. This conversion to null is done before any other attempted type-specific string conversion. The default value [ "" ] means that empty strings will be converted to null before any other processing takes place. Providing the empty list [] means that no conversion to null will be done, on any value. | ||||||||||||||||||||||
114 | Data Resource (file) | https://frictionlessdata.io/specs/table-schema#primary-key | resource/schema/primaryKey | yes | timestamp | A primary key is a field or set of fields that uniquely identifies each row in the table. | ||||||||||||||||||||||
116 | Data Resource (file) | https://frictionlessdata.io/specs/table-schema#field-descriptors | resource/schema/fields | yes | A field descriptor MUST be a JSON object that describes a single field. The descriptor provides additional human-readable documentation for a field, as well as additional information that may be used to validate the field or create a user interface for data entry. | |||||||||||||||||||||||
119 | Field (column) | https://frictionlessdata.io/specs/table-schema#name | resource/schema/field/name | yes | AT_load_entsoe_power_statistics | The field descriptor MUST contain a name property. This property SHOULD correspond to the name of field/column in the data file (if it has a name). As such it SHOULD be unique (though it is possible, but very bad practice, for the data file to have multiple columns with the same name). name SHOULD NOT be considered case sensitive in determining uniqueness. However, since it should correspond to the name of the field in the data file it may be important to preserve case. | ||||||||||||||||||||||
121 | Field (column) | https://frictionlessdata.io/specs/table-schema#description | resource/schema/field/description | yes | Total load in Austria in MW as published on ENTSO-E Data Portal/Power Statistics | A description for this field e.g. "The recipient of the funds" | ||||||||||||||||||||||
122 | Field (column) | https://frictionlessdata.io/specs/table-schema#types-and-formats | resource/schema/field/type | yes | datetime | Both type and format are optional: in a field descriptor, the absence of a type property indicates that the field is of the type "string", and the absence of a format property indicates that the field's type format is "default". | ||||||||||||||||||||||
123 | Field (column) | https://frictionlessdata.io/specs/table-schema#types-and-formats | resource/schema/field/format | optional | YYYY-MM-DDThh:mm:ssZ | Both type and format are optional: in a field descriptor, the absence of a type property indicates that the field is of the type "string", and the absence of a format property indicates that the field's type format is "default". | ||||||||||||||||||||||
128 | Field (column) | resource/schema/field/opsdContentfilter | yes | true | Whether users can filter the file on this column before downloading | |||||||||||||||||||||||
129 | Field (column) | resource/schema/field/unit | yes for time series | MW | Measurement unit for this column | |||||||||||||||||||||||
130 | Field (column) | resource/schema/field/source | yes for time series | The raw source for this column | ||||||||||||||||||||||||
131 | Field (column) | resource/schema/field/source/title | yes for time series | Amprion | title of the source (e.g. document or organization name) | |||||||||||||||||||||||
132 | Field (column) | resource/schema/field/source/path | yes for time series | http://www.amprion.net/en/photovoltaic-infeed | A url-or-path string, that is a fully qualified HTTP address, or a relative POSIX path | |||||||||||||||||||||||
133 | Field (column) | resource/schema/field/opsdProperties | yes for time series | Further properties to allow downloading only particular columns | ||||||||||||||||||||||||
134 | Field (column) | resource/schema/field/opsdProperties/Region | yes for time series | DE_amprion | Geographic region represented by this column | |||||||||||||||||||||||
135 | Field (column) | resource/schema/field/opsdProperties/Variable | yes for time series | solar_generation_actual | Variable covered by this column | |||||||||||||||||||||||
136 | Field (column) | yes for time series | ||||||||||||||||||||||||||
139 | ||||||||||||||||||||||||||||
140 | Links: | |||||||||||||||||||||||||||
141 | Data Package | https://frictionlessdata.io/specs/data-package | ||||||||||||||||||||||||||
142 | Tabular Data Package | https://frictionlessdata.io/specs/tabular-data-package | ||||||||||||||||||||||||||
143 | Data Resource | https://frictionlessdata.io/specs/data-resource | ||||||||||||||||||||||||||
144 | Tabular Data Resource | https://frictionlessdata.io/specs/tabular-data-resource | ||||||||||||||||||||||||||
145 | Table Schema | https://frictionlessdata.io/specs/table-schema | ||||||||||||||||||||||||||
146 | CSV Dialect | https://frictionlessdata.io/specs/csv-dialect | ||||||||||||||||||||||||||
147 | Profile | https://frictionlessdata.io/specs/profiles | ||||||||||||||||||||||||||
148 | ||||||||||||||||||||||||||||
149 | ||||||||||||||||||||||||||||
150 | ||||||||||||||||||||||||||||
151 | ||||||||||||||||||||||||||||
152 | ||||||||||||||||||||||||||||
153 | ||||||||||||||||||||||||||||
154 | ||||||||||||||||||||||||||||
155 | ||||||||||||||||||||||||||||
156 |