BENCHMARK ASSESSMENT PROCESS – 2022-23

Kate Cermak, MDE

Don Dailey, MiDataHub

Kevin Bullard, MiDataHub

AGENDA

1. Welcome and introductions
2. Overview of legislation and Fact Sheet/FAQ Document
3. Processes when using MiDataHub
4. Using the Benchmark Assessment Readiness Dashboard
1. Benchmark Aggregation – Verifying and/or creating the aggregate API (allows MEDC and EPIC to create aggregate from data)
2. Publish Data from your Student Information System
3. Maintain or create integrations for one or more of the four assessment vendors
1. Curriculum Associates i- Ready
2. DRC
3. NWEA
4. Renaissance Star
5. Mode of Instruction Reporting
6. Process for districts planning to do their own aggregates
• Location of template for self-aggregation
• Securely providing the file via SFTP to MiDataHub
7. MiDataHub cockpit Reports:
• 98 b queries
• Mode of instruction
• Assessment Reports
8. Aggregated results – Location and Review
9. Timelines
10. Q&A  

​

​

Note:  This webinar will be recorded

Benchmark Assessment Legislation

OVERVIEW, PROCESS, FAQ

The Law (Benchmark Assessment - Public Act 144  sec. 104h

• Districts must administer benchmark assessments
• twice a year in first 9 weeks of school and again before the last day of the school year
• to all students in K-8
• assessments must measure proficiency in reading and mathematics
• the same benchmark assessment(s) that were administered by the district in previous school years, to the extent practical

​

​

​

The Law (Continued)

• Districts must provide student data from the benchmark assessment(s) to the student’s parent or legal guardian within 30 days of administration
• Districts administering local benchmark assessments and assessments with progress monitoring tools must report the following to MDE and CEPI
• The assessment(s) administered
• How the assessment(s) measure change, including any losses
• The district’s plans for addressing any losses in learning
• If using one of the MDE-approved assessments, districts must send benchmark data including fall 2022 to spring 2023 growth, if available, to MDE within 30 days of administration

The Law (Continued)

• Districts may apply for funding of $12.50 per membership student in grades K-8 if they are:
• Administering NWEA Map, i-Ready or Star to students in grades K to 8 in reading and/or mathematics
• Administering the assessment in the first 9 weeks of the school year and again prior to the end of the school year
• Providing the benchmark data results and mode of instruction through MiDataHub 
• An application process will be provided through GEMS/MARS in early November. Payments are planned for mid-February 2023

District Choice

Which assessments?

• The following assessments are reported through the Michigan Data Hub
• Curriculum Associates i-Ready
• NWEA MAP
• Renaissance Star
• Smarter Balanced Interims Assessments
• MDE Early Literacy and Mathematics Benchmark Assessments

Which data are reported to the MDH?

• Student level data are reported to the Michigan Data Hub for aggregation.

What are the aggregation rules?

• Students tested in the Fall will be reported within 30 days of test administration
• Assessment data will be joined to student demographic data from MSDS to allow for disaggregation at the state level

Gender Race/Ethnicity Students with Disabilities* Homeless English Learners *Primary Disability Migrant Military Connected Economically Disadvantaged Foster

How will the data be kept safe?

• Michigan Data Hub has secured data sharing agreements with EPIC and MEDC
• All three organizations have considerable experience in keeping highly sensitive data secure
• Research partners have built security protocols in consultation with university and SOM security experts
• Sensitive data is housed by MEDC on servers hosted by U-M data centers in Washtenaw County
• Servers are highly secure and approved for use with FERPA, Export Controlled (ITAR, EAR), PII, HIPAA, and Sensitive Human Subject Research data
• Servers are monitored 24/7 for network and physical intrusion and security updates are regularly applied
• Group-based access controls ensure data access follows principal of least privilege
• Separate server instances prevent comingling of identifiable and de-identified data
• Virtual data enclaves requiring VPN and two-factor authentication allow approved researchers access to analyze the data without removal from the protected data centers

Who will have access to the data?

• Student-level data
• Michigan Data Hub – collects the data
• MEDC and EPIC – aggregates the data
• Aggregated data
• CEPI
• MDE

How long will the data be kept?

• Districts specify how long student-level data is kept in the MDH
• MEDC and EPIC will destroy student-level data 60 days after the end of the Benchmark Assessment reporting project
• State of Michigan (MDE and CEPI)
• Aggregated data becomes part of the SOM administrative data sets and will be retained for analysis in accordance with state records retention and disposal rules.

​

How will the data be reported?

• Based on the statewide aggregates, EPIC will develop and MDE will provide a report to the Governor and education-related standing committees of the state House and Senate
• Report will discuss student performance and growth as determined by the benchmark assessments
• Aggregate data may be subject to FOIA rules both locally and at the state level
• Districts may choose to share data with parents and community to provide local context (see Sec 98b. of PA 144)

​

Reporting through the GEMS/MARS

Grant Electronic Monitoring System/Michigan Administrative Review System

GEMS/MARS process

• Which assessments: all assessments administered must be identified in the survey
• Complete survey: TBD - late November/early December
• What data are requested?
• Which local assessment(s)/Assessments with progress monitoring were used and in which grades?
• How did the assessment(s) measure change, including learning loss?
• What are the plans to address any loss in learning?
• Apply for funding if NWEA MAP, I-Ready, or Star were administered.

​

​

​

PROCESSES WHEN USING MIDATAHUB

Processes when using MiDataHub

• Using the Benchmark Assessment Readiness Dashboard
• Benchmark Aggregation – Verifying and/or creating the aggregate API (allows MEDC and EPIC to create aggregate from data)
• Publish Data from your Student Information System
• Maintain or create integrations for one or more of the four assessment vendors
• Curriculum Associates i- Ready
• DRC
• NWEA
• Renaissance Star

�

In most cases districts that used MDH last year for aggregation, and are using the same assessments, won’t need to make any configuration changes

BENCHMARK ASSESSMENT READINESS DASHBOARD

The Benchmark Assessment dashboard provides end users a visual representation of status of both required and optional services (MiDataHub Cockpit > Features > Benchmark Assessment)

BENCHMARK ASSESSMENT READINESS DASHBOARD - CHECKS

Green = Pass

Red X = Need to Review

​

Not all items on this screen need to be completed (Green) to be ready for Benchmark Assessment, only the required checks, and integrations for assessments your districts is using for the aggregate.

BENCHMARK ASSESSMENT READINESS DASHBOARD - CHECKS

Required Checks:

• SIS 1 Passed –SIS integration is active
• Assessments – At least 1 active integration
• Benchmark Assessment –Aggregate API is active

Optional Checks:

Data Readiness Status on the 4 MDE recommended assessments:

• Need to confirm the assessment your district is using for the aggregate is configured
• Failed – the configured assessment has no data populated
• Info – assessments are not configured

Mode of Instruction

• Provide total counts of students identified with a mode of instruction.

LOAD YOUR SIS DATA TO MIDATAHUB �

How do I publish data from my Student Information System to MiDataHub? 

​

​

Website: MiDataHub.org > Product Catalog

• Product Catalog
• SIS Configuration Guides
• Vendor specific integration documentation 
• Documentation
• Vendor specific
• MiDataHub 

�

WHAT IF I AM NOT ON THE MDH?

SIS Integrated

• Integrated SIS: Infinite Campus, MISTAR-Q, PowerSchool, Skyward, Synergy
• Contact MiDataHub for assistance in loading benchmark results
• support@midatahub.org
• (269) 250-9240

SIS Not Integrated

• Non-integrated SIS: all others
• MDH has developed an import process to populate these districts from an MSDS General Collection file
• Once district is loaded to MSD, contact MIDataHub for assistance
• The 2022-23 import is being revised and will be available soon. Please stay connected with updates on this in our newsletter.

MSDS IMPORT:�MY DISTRICT IS NOT USING A SIS CAPABLE OF PUBLISHING DATA TO MIDATAHUB

Using the MSDS General Collection import if your district is not using a SIS supporting the Ed-Fi API �

In order to address districts that have an unsupported SIS, or in some cases no SIS at all:

​

• Michigan Student Data System (MSDS) import allows MiDataHub to be populated from the CEPI MSDS

​

• If your district used this process previously you don’t need to recreate the API (see documentation link below)

​

• Not a complete set of data but provides enough data to populate the ODS in MiDataHub

​

• The MSDS import process is not recommended for districts on a SIS capable of full integration, as those systems provide a more robust population of data

​

• Link to documentation walking through both scenarios:
• Create new MSDS import integration
• Use existing MSDS Import integration

​

​

HOW ARE THE DATA REPORTED FOR DISTRICTS USING MIDATAHUB FOR AGGREGATION?

In most cases districts who use MDH last year for aggregation, and are using the same assessments, won’t need to make any configuration changes

​

• File-based integration: districts provide permission through a data sharing agreement for the assessment vendor to allow MDH to receive benchmark results for processing
• Application Programming Interface (API) integration: APIs create secure direct connections between processing partners
• Districts can create the API integration themselves and provide the credentials to the vendor, or
• Districts may request the MDH to create the API integration

​

If the Benchmark Assessment option shows as failed on the Benchmark Assessment Dashboard, please follow the steps on the next slide to Create an API Integration for Data Aggregation by MEDC/EPIC. Please also verify this integration was not deactivated, if it was simply reactivate it.

​

CREATING THE BENCHMARK ASSESSMENT AGGREGATE API

The Aggregate API will need to be completed by a Technical Contact in your districts MiDataHub cockpit. Completing this API will confirm your districts participation with the Benchmark Assessment Legislation and allow the Michigan Education Data Center and Educational Policy Innovation Collaborative to compute the aggregates based on the assessment data you have selected to use for this work.

Step by step instructions on configuring this API are located on the product catalog page at MiDataHub.org

​

Step 1: Login to MiDataHub by navigating to https://launchpad.midatahub.org/ , select your district from the list, and login either using your local districts credentials (if federated to the SSO) or your MiDataHub Login (not federated to the SSO)

Step 2: Navigate to your districts MiDataHub cockpit

Step 3: Scroll to the API Integrations section (bottom right corner of screen)

and click on the Add Integration link:

Step 4: Follow the steps on the next slide to configure the API

�

CREATE AN API INTEGRATION FOR DATA AGGREGATION BY MEDC/EPIC (IF SHOWING AS FAILED ON THE RTL DASHBOARD)

Create the API using the selections below:

• System Type: Educational Analytics
• Vendor: Michigan Education Data Center (MEDC)
• System: Return to Learn Aggregation – v1
• Profile: None
• **Click Submit when these selections are made

�

CREATE THE AGGREGATE API INTEGRATION (IF FAILED ON DASHBOARD)

If the Assessments option shows as failed on the Benchmark Assessment Dashboard for assessments, please follow the steps on the next slide to Create an Integration for one of the four identified MDE assessments your district will use for the aggregate. Please also verify that the integration was not deactivated, if it was, simply reactivate.

​

CREATING THE BENCHMARK ASSESSMENT ASSESSMENT API (IF SHOWING AS FAILED ON RTL DASHBOARD)

Creating an API for the integration with i-Ready is completed in the MiDataHub cockpit

​

1. The Curriculum Associates i-Ready integration is an API integration
2. Follow the steps in the i-Ready Product Catalog Page to create the integration
3. Contacts:
• Thomas Mignosa, Senior Product Manager, tmignosa@cainc.com
• Seth Winerman, Senior Product Manager, swinerman@cainc.com

​

Eligible for the $12.50 funding per membership in grades K-8

I-READY – LOADING MDE-IDENTIFIED ASSESSMENTS TO MIDATAHUB

Creating an API for the integration with DRC is completed in the MiDataHub cockpit

​

1. The DRC Smarter Balanced Interim (Grades 3-5) and Early Literacy and Mathematics Benchmark Assessments(Grades K-2) integration is an API integration
2. Follow the steps in the DRC Product Catalog Page to create the integration
3. Requires MiDataHub team to send a student file to DRC to trigger the data load
4. Contacts:
1. Christi Linton, Clinton@datarecognitioncorp.com, 301-865-9859
2. Ryan Nelson, rnelson@datarecognitioncorp.com, 763-268-2361
3. Smarter interims, misupport@datarecognitioncorp.com, 877-560-8378 option 2
4. Early Literacy and Math, mde-oeaa@michigan.gov, 877-560-8378 option 3
5. Available at no cost to districts

DRC – LOADING MDE-IDENTIFIED ASSESSMENTS TO MIDATAHUB

Creating an inbound integration with NWEA is completed in the MiDataHub cockpit

​

1. The NWEA MAP integration is a file-based inbound integration
2. Follow the steps in the NWEA Product Catalog Page to create the integration
3. Requires a permission form to be signed and emailed to support@midatahub.org
4. Data files show up in a zip file in the NWEA-MiDataHub SFTP account
5. Contact:
1. Leslie Shotola, Operations Coordinator, leslie.shotola@nwea.org

Eligible for the $12.50 funding per membership in grades K-8

NWEA – LOADING MDE-IDENTIFIED ASSESSMENTS TO MIDATAHUB

Creating an inbound integration with Renaissance Star is completed in the MiDataHub cockpit

​

1. The Renaissance Star integration is an API integration
2. Follow the steps in the Star Assessments Product Catalog Page to create the integration
3. Data files show up in a zip file in the Star-MiDataHub SFTP account
4. Contacts:
• Primary Contact: Jennifer Grimes, Director of Partnerships, jennifer.grimes@renaissance.com
• Integration Contact: Amanda Potts, Manager, Data & Integration Services, amanda.potts@renaissance.com

Eligible for the $12.50 funding per membership in grades K-8

STAR – LOADING MDE-IDENTIFIED ASSESSMENTS TO MIDATAHUB

NEED FOR MODE OF INSTRUCTION

• Legislation calls for districts to provide the Mode of Instruction in their aggregates
• FULLY IN-PERSON: Students in this subgroup primarily received instruction in a fully in-person/face-to-face format.
• HYBRID: Students in this subgroup primarily received instruction a hybrid format where a portion of their instruction was provided in-person and a portion was provided remotely (e.g., half-day in-person and half-day remote, alternating one day in-person then one day remote, etc.).
• FULLY REMOTE: Students in this subgroup primarily received instruction in a fully remote or virtual format.
• This requires knowing the status of each student during the Fall and End of Year assessment windows
• Focus is on the PRIMARY mode of instruction, or the status for each student overall. We know this can change on a daily basis due to many factors.
• All integrated SIS tools are able to publish the Mode of Instruction data for students
• In MiDataHub, we receive the data as StudentCohortAssociations with students tied to each of the three modes as Cohorts

​

SELF-AGGREGATION – WHERE IS THE TEMPLATE LOCATED?

Self-aggregation template available on the Benchmark Assessment webpage

• Single template containing multiple tabs for each reporting period

​

​

Self-aggregated file can be provided to MiDataHub by the following: 

​

Secure File Transport Protocol (SFTP):  Districts providing their own aggregated files can upload files using the District Folder link in MiDataHub to securely upload files

• Email support@midatahub.org to notify that files have been placed in the District Folder, providing the district name
• Files are automatically deleted after 7 days

​

SECURELY PROVIDING FILE TO MIDATAHUB

1. Self Aggregated file will be submitted by Technical contact to secure location in the MiDataHub cockpit.
1. Login to MidataHub cockpit and select the District Folder
2. Upload and import file.
3. Email support@midatahub.org informing us that you have submitted a self created aggregate file.

MIDATAHUB COCKPIT – VERIFICATION REPORTS�MODE OF INSTRUCTION

Link to MiDataHub – Mode of Instruction Verification Documentation

​

Mode of Instruction Summary - Provides computed totals by Mode of Instruction Category (Fully In-Person, Fully Remote, and Hybrid).

Mode of Instruction Verification Summary - Provides a list of students and their Mode of Instruction cohort data.

REVIEW A COPY OF YOUR DISTRICTS AGGREGATED RESULTS

• Aggregated results will be placed into the District SFTP folder
• Filename will contain district number and file will only have your district's data
• Email will be sent to superintendent on record
• Not intended as approval, but an opportunity to identify issues that affect accuracy and usability

Data Validation Queries

We offer a wide variety of scripts to choose from that will provide access to export and review student data. Please follow this link for step-by-step instructions on the process to create the queries.

​

Available queries:

Assessment Inventory

• Provides a list of assessments for the district and record counts for various aspects of the assessments.

Assessment Objective Performance Level Validation

• Provides a combined list of objective performance level results.

Assessment Objective Score Validation

• Provides a combined list of all objective assessment scores for validation purposes.

Assessment Performance Level Results

• Provides a list of students with their assessment performance levels.

Assessment Score Results Validation

• Provides a combined list of overall assessment scores.

​

STEP 3: VERIFY DATA LOADING (SIS/ASSESSMENTS)

• Will provide more instructions as time draws closer
• Similar reports provided from MiDataHub as last year

MIDATAHUB COCKPIT – VERIFICATION REPORTS

98B QUERIES

TENTATIVE TIMELINES – WORKING BACKWARD

• November 4, 2022 – Calculated as last day to assess students (First 9 weeks of school)
• November 25, 2022 – All steps in MiDataHub must be completed in order to guarantee data is ready for aggregation when needed
• December 2, 2022 – Data due to MEDC for aggregation

RESOURCES

• Michigan Data Hub Resources

• MDE Resources

• Benchmark Assessment web page
• www.Michigan.gov/mde-benchmarkassessments
• Benchmark Assessments Reporting FAQ

• Product Catalog
• SIS Configuration
• Assessment Configuration
• Aggregation API Integration
• Data Validation Queries
• Support
• Newsletter

Q&A

THANKS FOR JOINING