RETURN TO LEARN BENCHMARK ASSESSMENT PROCESS – RENAISSANCE STAR

Kevin Bullard

Kate Cermak

Don Dailey

Renaissance Team

EPIC/MEDC Research Team

AGENDA

1. Welcome and Introductions
2. Return to Learn Benchmark Assessment Legislation – Overview, Process and FAQ (Kate Cermak, MDE)
3. Deeper Dive – Return to Learn Data Flow
• Step 1: Load your SIS data to MiDataHub 
• Step 2: Load one or more MDE-Identified Assessments to MiDataHub (CA I-Ready, DRC, NWEA MAP, Renaissance Star) 
• Step 3: Verify data loading
• Step 4: Create an API Integration for Data Aggregation by MEDC/EPIC 
• Step 5: Review a copy of your aggregated results 
• Step 6: MiDataHub will submit compiled statewide aggregates to CEPI
4. Timelines
5. Q&A

​

​

Note:  This webinar will be recorded�

Return to Learn Benchmark Assessment Legislation

OVERVIEW, PROCESS, FAQ

The Law (Return to Learn - Public Act 149 sec. 4)

• Districts must administer benchmark assessments
• twice a year in first 9 weeks of school and again before the end of the school year
• to all students in K-8
• assessments must measure proficiency in reading and mathematics
• results may not be used for accountability purposes

​

​

District Choice

Which assessments?

• The following assessments are reported through the Michigan Data Hub
• Curriculum Associates i-Ready
• NWEA MAP
• Renaissance Star
• Smarter Balanced Interims Assessments
• MDE Early Literacy and Mathematics Benchmark Assessments

How are the data reported?

• File-based integration: districts provide permission through a data sharing agreement for the assessment vendor to allow MDH to receive benchmark results for processing
• Application Programming Interface (API) integration: APIs create secure direct connections between processing partners
• Districts can create the API integration themselves and provide the credentials to the vendor, or
• Districts may request the MDH to create the API integration

​

How are the data reported?

Which data are reported to the MDH?

• Student level data are reported to the Michigan Data Hub for aggregation.

What happens to the data after it is reported?

• Research partners will perform statewide aggregations
• Michigan Education Data Center (UofM - MEDC)
• Educational Policy Innovation Collaborative (MSU - EPIC)
• Districts will need to create an API integration (or request one be created by MDH) to allow research partners access to the data
• Once aggregated, data will be returned to MDH for validation
• MDH will provide districts a copy of their aggregated results
• MDH will share with aggregated files with MDE and CEPI for mandated reporting

What are the aggregation rules?

• Only students tested in both fall and spring will be included
• Assessment data will be joined to student demographic data from MSDS to allow for disaggregation at the state level

Gender Race/Ethnicity Students with Disabilities* Homeless English Learners *Primary Disability Migrant Military Connected Economically Disadvantaged Foster 2019 M-STEP Performance Levels

How will the data be kept safe?

• Michigan Data Hub has secured data sharing agreements with EPIC and MEDC
• All three organizations have considerable experience in keeping highly sensitive data secure
• Research partners have built security protocols in consultation with university and SOM security experts
• Sensitive data is housed by MEDC on servers hosted by U-M data centers in Washtenaw County
• Servers are highly secure and approved for use with FERPA, Export Controlled (ITAR, EAR), PII, HIPAA, and Sensitive Human Subject Research data
• Servers are monitored 24/7 for network and physical intrusion and security updates are regularly applied
• Group-based access controls ensure data access follows principal of least privilege
• Separate server instances prevent comingling of identifiable and de-identified data
• Virtual data enclaves requiring VPN and two-factor authentication allow approved researchers access to analyze the data without removal from the protected data centers

Who will have access to the data?

• Student-level data
• Michigan Data Hub – collects the data
• MEDC and EPIC – aggregates the data
• Aggregated data
• CEPI
• MDE

How long will the data be kept?

• Districts specify how long student-level data is kept in the MDH
• MEDC and EPIC will destroy student-level data 60 days after the end of the Return to Learn reporting project
• State of Michigan (MDE and CEPI)
• Aggregated data becomes part of the SOM administrative data sets and will be retained for analysis in accordance with state records retention and disposal rules.

​

How will the data be reported?

• Based on the statewide aggregates, EPIC will develop and MDE and CEPI will provide a report to the Governor and education-related standing committees of the state House and Senate
• Report will identify the number and percentage of students who are significantly behind grade level as determined by the benchmark data
• Aggregate data may be subject to FOIA rules both locally and at the state level
• Districts may choose to share data with parents and community to provide local context

​

What if I am not on the MDH?

SIS INTEGRATED

• Integrated SIS: PowerSchool, Infinite Campus, MISTAR, Skyward, Synergy
• Contact MiDataHub for assistance in loading benchmark results
• support@midatahub.org
• (269 250-9240

SIS NOT INTEGRATED

• Non-integrated SIS: all others
• MDH is developing an import process to populate these districts from an MSDS General Collection file
• Once district is loaded to MSD, contact MIDataHub for assistance

Reporting through the GEMS/MARS

Grant Electronic Monitoring System/Michigan Administrative Review System

GEMS/MARS process

• Which assessments: everything else
• Complete survey: deadline was 4/12/21
• Contact cepi@michigan.gov if submission not completed
• What data was requested?
• Which local assessment(s) were used and in which grades?
• How did the assessment(s) measure change, including learning loss?
• What are the plans to address any loss in learning?
• What happens now: CEPI/MDE will provide a report to the Governor and education-related standing committees of the state House and Senate

​

​

​

Resources

MDE RESOURCES

• Return to Learn Benchmark Assessments web page
• www.Michigan.gov/mde-benchmarkassessments
• Benchmark Assessments Reporting FAQ

MICHIGAN DATA HUB RESOURCES

• Product Catalog
• SIS Configuration
• Assessment Configuration
• Aggregation API Integration
• Data Validation Queries
• Support
• Newsletter

DEEPER DIVE:  RETURN TO LEARN OVERALL DATA FLOW PROCESS

Step 1: Load your SIS data to MiDataHub

Step 2: Load one or more MDE-Identified Assessments to MiDataHub (CA I-Ready, DRC, NWEA MAP, Renaissance Star)

Step 3: Verify data loading

Step 4: Create an API Integration for Data Aggregation by MEDC/EPIC

Step 5: Review a copy of your aggregated results

Step 6: MiDataHub will submit compiled statewide aggregates to CEPI

�

STEP 1: LOAD YOUR SIS DATA TO MIDATAHUB �

How do I publish data from my Student Information System to MiDataHub?

​

​

Website: MiDataHub.org > Product Catalog

• Product Catalog
• SIS Config Guides
• Vendor specific integration documentation
• Documentation
• Vendor specific
• MiDataHub

�

STEP 1: LOAD YOUR SIS DATA TO MIDATAHUB – MSDS GENERAL COLLECTION

Using the MSDS General Collection roster import when your district is not using a SIS that supports the Ed-Fi API �

In order to address districts that have an unsupported SIS, or in some cases no SIS at all:

​

• Michigan Student Data System (MSDS) import allows MiDataHub to be populated from the CEPI MSDS

​

• Not a complete set of data but provides enough data to populate the ODS in MiDataHub

​

• The MSDS import process is not recommended for districts on a SIS capable of full integration, as those systems provide a more robust population of data

​

• Further instructions and a webinar will be held when this is available

​

​

LOADING ASSESSMENT DATA – RENAISSANCE STAR OVERVIEW

Mike Hadaway

Laurie Borkon

Renaissance Learning

LOADING ASSESSMENT DATA – RENAISSANCE STAR OVERVIEW

Renaissance - Michigan Return to Learn Webinar - data sharing - April 27 2021

Completing these steps will confirm your district's participation with the Return to Learn Legislation using the Renaissance STAR Assessments. 

​

Step by step instructions on configuring this integration, along with contact information for the Renaissance STAR assessment are located on the product catalog page at MiDataHub.org. 

​

Navigate to the link above and type “Renaissance STAR” in the search box

​

Open the Steps to configure Renaissance STAR with MiDataHub document and follow the steps

​

​

​

​

​

​

Step 2: Load one or more MDE-Identified Assessments to MiDataHub (Renaissance STAR)

​

A few key steps in the configuration:

• Step 2: Initial email to support@renaissance.com will enable the authorization of Renaissance to provide assessment data to MiDataHub
• During the step of Manually Entering State ID’s in Renaissance please ensure you have completed step 3 – “enter the state number value”
• If at any time you have questions, please don’t hesitate reaching out to support@midatahub.org 

​

​

STEP 2: LOAD ONE OR MORE MDE-IDENTIFIED ASSESSMENTS TO MIDATAHUB (RENAISSANCE STAR)

MiDataHub Assistance

​

• After Step 2 of the configuration guide has been completed (emailing Renaissance STAR), data exports will be pushed from Renaissance STAR to the SFTP site for MiDataHub to begin ingesting. 

​

• Upon seeing files for your district, the MiDataHub team will create the inbound integrations and will ensure that assessment results begin importing as provided. 
• Please note, all district files MUST have the district code added as described under the “enter the state number value” section in the configuration guide. Please reference the screenshot provided. Only districts that have added the district code will be imported to MiDataHub. 

​

Step 2: Load one or more MDE-Identified Assessments to MiDataHub (Renaissance STAR)

STEP 3 – VERIFYING DATA IN MIDATAHUB (SIS)

Data Hub Cockpit > Reports > View District Reports > Data Quality > At a Glance Report

�

Helps determine: 

• Students without schedules
• Attendance events
• Academic Marks
• Student counts (Bldg, District, Grade)
• Courses/Sections
• # of Contacts
• Program Information 
• Demographics
• Attendance
• And much, much, more

​

​

Data Validation Queries

We offer a wide variety of scripts to choose from that will provide access to export student data from MiDataHub.

​

Link to available queries:

Validation Scripts

There are multiple formats to download the data for reviewing including 

CSV, TXT, etc. 

STEP 3: VERIFY DATA LOADING (SIS/ASSESSMENTS)

STEP 3: VERIFY DATA LOADING (SIS/ASSESSMENTS)

Data Freshness

�

School Data Load Analysis

�

The School Data Load Analysis provides users a breakdown of data loaded in several categories for each school building. Student Sections, Student Enrollment, Staff Sections, attendance, Transcripts, and much more.

�

The Data Freshness script allows users to see which tables are populated, when they were first populated, and when they were last updated.

STEP 3 – VERIFYING DATA IN MIDATAHUB (RENAISSANCE STAR DATA)

Query – Renaissance STAR Return to Learn Verification

• Link to available queries: Validation Scripts
• When used in MiDataHub the Data Validation queries offer a wide variety of options to verify and validate data currently in the ODS
• There are multiple formats to download the data for reviewing including CSV, TXT, etc. 
• Link to documentation for using the Manage Custom Exports tool in the MiDataHub Cockpit
• Video tutorial on creating exports using the validation queries 

STEP 3 – VERIFYING DATA IN MIDATAHUB (RENAISSANCE STAR DATA)

Query – Renaissance STAR Return to Learn Verification

When configured as a custom export in MiDataHub, the Renaissance STAR - Return to Learn Verification provides validity of data populated from Renaissance STAR to your MiDataHub ODS. 

​

Follow the steps and links below to create this script in the MiDataHub cockpit:

• Link to available queries: Validation Scripts
• Link to documentation for using the Manage Custom Exports tool in the MiDataHub Cockpit
• Video tutorial on creating exports using the validation queries 

​

​

The Aggregate API will need to be completed by a Technical Contact in your districts MiDataHub cockpit. Completing this API will confirm your districts participation with the Return to Learn Legislation and allow the Michigan Education Data Center and Educational Policy Innovation Collaborative to compute the aggregates based on the assessment data you have selected to use for this work.

Step by step instructions on configuring this API are located on the product catalog page at MiDataHub.org

​

Step 1: Login to MiDataHub by navigating to https://launchpad.midatahub.org/ , select your district from the list, and login either using your local districts credentials (if federated to the SSO) or your MiDataHub Login (not federated to the SSO)

Step 2: Navigate to your districts MiDataHub cockpit

Step 3: Scroll to the API Integrations section (bottom right corner of screen)

and click on the Add Integration link:

�

STEP 4: CREATE AN API INTEGRATION FOR DATA AGGREGATION BY MEDC/EPIC

Step 4: Create the API using the selections below:

• System Type: Educational Analytics
• Vendor: Michigan Education Data Center (MEDC)
• System: Return to Learn Aggregation – v1
• Profile: None
• **Click Submit when these selections are made

�

STEP 4: CREATE AN API INTEGRATION FOR DATA AGGREGATION BY MEDC/EPIC

STEP 5: REVIEW A COPY OF YOUR AGGREGATED RESULTS

• Aggregated results will be placed into the District SFTP folder
• Filename will contain district number and file will only have your district's data
• Email will be sent to superintendent on record
• Not intended as approval, but an opportunity to identify issues that affect accuracy and usability

STEP 6: MIDATAHUB WILL SUBMIT COMPILED STATEWIDE AGGREGATES TO CEPI

• All aggregated district files will be combined together and forwarded to CEPI for their reporting

TIMELINES – WORKING BACKWARD

• September 1, 2021 – Report due to Governor and legislative subcommittees
• June 30, 2021 – District deadline for providing assessment data for aggregation
• June 1, 2021 – Recommended deadline for loading assessment and SIS data
• May 14, 2021 – Estimated availability of MSDS import process

Q&A

THANKS FOR JOINING