DDI-CDI and Other Standards

Overall goal�

To define general patterns for translating between different data models (SDMX, schema.org, etc) using DDI-CDI as the “link” between those standards

​

Making dataset “integration-ready”

• Describe source datasets using the DDI-CDI vocabulary
• This requires mapping specific objects in the source dataset to individuals of specific classes in the DDI-CDI vocabulary. 
• The mapping connects the main “entities” and “relations” of the source model (e.g., SDMX artifacts or schema.org classes or properties) to the relevant subset of DDI-CDI classes and properties in the target model
• Accompanying the DDI-CDI data descriptions, the dataset is converted into a wide-form tabular array (with columns corresponding to each dimension, measure, and attribute component), serialized as csv. 

�

Producing the target integrated dataset

• The target data structure is also specified using the same DDI-DCI profile.
• Mappings between source and target represented variables
• Mappings between source and target codes for each variable whose value domain is given by a code list.
• Automating data integration (python scripts)

​

DDI-CDI Profile

Example 1: Global SDG Indicators� From SDMX to DDI-CDI

• Source SDMX artifacts describing the global SDG dataset available from the SDMX Global registry.
1. Concept Scheme
2. Data Flow,
3. Data structure definition
4. Code lists.
• Translate this SDMX dataset description into DDI-CDI (Output: SDG Indicators schema in .ttl )

​

The SDMX information model

SDMX-to-DDI-CDI “connector” mapping

Example 2: Global SDG Indicators�

From Data Commons schema to DDI-CDI

​

Data Commons� schema

MCF files describing the global SDG dataset have been produced as part of the UN Data modernization project

• dcs:UNDATA_SDG_Series
• dcs:StatisticalVariable
• schema:Enumeration
• dcs:UNDATA_SDG_UnitOfMeasure
• dcs:UNDATA_SDG_MeasurementMethodEnum

​

​

​

​

​

Node: dcid:undata/sdg/SI_POV_DAY1.AGE--Y0T14

typeOf: dcs:StatisticalVariable

name: "Proportion of population below international poverty line [under 15 years old]“

measuredProperty: dcs:value

populationType: dcs:UNDATA_SDG_SI_POV_DAY1

age: dcs:UNDATA_SDG_AgeEnum_Y0T14

footnote: "Includes data from the following sources: Poverty and Inequality Portal, World Bank"

Node: dcid:UNDATA_SDG_AgeEnum

typeOf: schema:Class

subClassOf: schema:Enumeration

name: "Age Enumeration"

​

Node: dcid:UNDATA_SDG_AgeEnum_Y0T14

typeOf: dcs:UNDATA_SDG_AgeEnum

name: "under 15 years old"

Node: dcid:UNDATA_SDG_SI_POV_DAY1

typeOf: dcs:UNDATA_SDG_Series

name: "Proportion of population below international poverty line“

source: "https://unstats.un.org/sdgs/dataportal/database"

Code List