Reciprocity
L3 Module Slide Template
Directions: Make a copy of this slide deck for your L3 and edit as you wish
This one deck will guide you through all of this module’s activities over the course of multiple meetings
Project Goals
Who We Are:
[Community Name Here] L3 Coalition
Families
Insert names here
Students
Insert names here
Educators
Insert names here
Community
Insert names here
Where are we?
Empathize | Define | Ideate | Prototype | Test |
Formed a local, inclusive coalition Conducted local empathy interviews | Analyzed empathy data and refined KCAE user profiles for our local context Created Problem Statement and “HMW” question | Brainstorming session for possible solutions Select an idea to prototype | Develop a user experience prototype Design a creative matrix | Feedback testing (surveys, interviews) and prototype refinement Scaled implementation of prototype |
We are here!
Where are we? Version 3
Assessment of the quality of the User Experience
A local system of accountability
Recommendations for state system of accountability
These prototypes are developed by your local coalitions
This prototype is created between the L3s, KCAE and KDE
[insert your prototype]
Guiding our work:
Our Problem Statement:
INSERT HERE
Our “How Might We?” Question:
INSERT HERE
Our Commonwealth Theme: | INSERT HERE |
Our proposed solution / prototype idea: | INSERT HERE |
Reciprocity
Activity 1:
IDEA TESTING
At the end of this activity, our coalition will have….
a testing plan to gather feedback from a variety of users about whether our prototype idea addresses an important need.
Step 1: Sharpen Our Hypothesis
If we (prototype idea), then (user need) will be addressed and envisioned future state theme will be achieved.
Step 2: Create Our Testing Plan
Write your Introduction Script
Choose Questions to Gather Feedback
Step 3: Identify People to Interview
User Type (Teacher, student, etc…) | Coalition Member | Networks, organizations and connections |
| | |
| | |
| | |
| | |
| | |
| | |
The below questions can also help you structure your process.
Gut Check & Reflection
Activity Wrap-Up
Gut check:
Look at the list of people we are planning to test with.
Are there groups you really need to talk to that are not on that list?
Reciprocity
Activity 2:
ITERATION
At the end of this activity, our coalition will have…. a revised prototype.
Step 1: Cataloging the Feedback
User Type | Coalition Member | Feedback on the Prototype Idea |
| | |
| | |
| | |
Discussion Question:
Are there themes or patterns in the feedback? Are there any trends by user?
Step 2: Persist, Pivot or Perish?
Given the feedback, what will you do?
Indicators We Should Persist | Indicators we should Pivot | Indicators we should Perish |
| | |
Step 3: Revising the Prototype
If you decided to Perish this Prototype: Go back to your ideation list and continue to ideate if helpful. Identify a different promising idea and build out a prototype.
If you decided to Pivot: Go back to the Creative Matrix or Storyboard you created, and adjust it based on the feedback you heard from users.
Step 4: Test Again
Consider going back to the same users you asked for feedback and showing them a revised version.
Are there additional users you need to test the idea with now?
Gut Check & Reflection
Activity Wrap-Up
Do a gut check.
Zoom into the feedback from users who are currently least well served by the system. Does the feedback suggest that the prototype will address their needs?
Reciprocity
Activity 3:
Implementation Planning (PDSA)
At the end of this activity, our coalition will have…. a 30-60-90 day plan for implementation.
Step 1: (PLAN) Create a Clear Action Plan for Testing
Step 1: (PLAN) Create a Clear Action Plan for Testing
Our Theory of Action for improvement in this cycle is IF WE: _____THEN________
The members of our team will be responsible for the following actions between now and the end of the cycle:
Member | Task | Timeline |
| | |
| | |
Step 2: (DO) Record & Reflect
Step 2: (DO) Record & Reflect
Carry out your action steps
Collect the data you identified
Step 3: (STUDY) Reflect on Learning
Step 3: (STUDY) Reflect on Learning
Use a protocol to check fidelity of your implementation actions
Review the data you have collected and summarize what you have learned
Step 4: (ACT)
Decide on Next Steps
Step 4: (ACT)
Decide on Next Steps
Meet as a team to review data and decide to adopt, adapt, or abandon.
Gut Check & Reflection
Activity Wrap-Up
Reciprocity
Activity 4:
Local Improvement & Accountability Planning
At the end of this activity, our coalition will have…. a model of a local accountability system for our prototype.
Why does this step matter so much?
To YOU:
By May 12, we will have a process for local accountability that will help you improve your implementation quality and impact.
For the State System
By May 12, Cohort 1 of the L3 communities will have integrated our learning about our desired accountability systems. This integration will help us influence the state system.
Steps Now… and Next
Now, as a full Coalition we will work together to answer the questions:
Next, with the support of the L3 Design Team and Assessment and Accountability partners, we will:
These products will be shared with the KCAE and KDE to inform changes to state assessment and accountability!
Next Steps
April 14: L3 Community of Practice
By April 30: Meet with Local Coalitions to discuss accountability and improvement
By May 10: Meet with our Technical Advice Team (Andre, Sandy, Susan + your support coach) NOTE: we will schedule this today!
May 12: Next L3 Community of Practice meeting - preparing for summer and fall!
Step 1:
Revisit Our Problem & HMW Statements
(insert your own district’s problem statement here)
Problem: Users don’t understand how the district utilizes the Profile of a Graduate.
Step 2:
Reflect on our Prototype
Let’s reflect on our prototype. If the prototype “works…”
Data vs. Evidence
Step 3. Develop a model for local accountability
Our team is going to design a local system of accountability around our prototype that is intended to ensure your prototype is meeting its intended goals.
There are three questions that drive our model:
1) How do we know our prototype is happening in the way we want?
2) How do we know the intended outcomes are occurring because of the prototype?
3) How do we communicate about the learning and how do we check our perception with our community?
EQUITY CHECK: Do our most marginalized students and families have access to quality experiences and are their outcomes comparable? How might we prioritize their stories, data and insights?
Plan
Where we are going - Reciprocity 4 Spreadsheet
Next Steps
April 14: L3 Community of Practice
By April 30: Meet with Local Coalitions to discuss accountability and improvement
By May 10: Meet with our Technical Advice Team (Andre, Sandy, Susan + your support coach) NOTE: we will schedule this today!
May 12: Next L3 Community of Practice meeting - preparing for summer and fall!
Gut Check & Reflection
Activity Wrap-Up
A Different Way to Think about Data
Satellite Data Map Data Street Data
Types of Data
Type | Examples | Advantages | Drawbacks |
Satellite Data | Test scores, Attendance Rates & graduation rates | Can illuminate big performance trends & point toward underserved student groups | Lagging data, doesn’t inform instruction, removed from local context, can reinforce biases |
Street Data | Lexile levels gathered through running record assessments, rubric scores on a common math assessment, or student perception data from a schoolwide survey. | Shows learning trends and gaps in a school community, actionable for instruction decisions. | Lacks the texture required to inform and shape equitable change |
Street Data | Student interviews, analysis of student work, focus groups, shadowing a student data | Leading indicators can fuel rapid cycles of learning then doing, feedback loop that can center marginalized voices. | Challenging to quantify/count and communicate |
Step 3: Evaluate Sufficiency of Data for Meeting Needs
For each of the data sources listed above, evaluate its sufficiency for meeting the data needs of the project. Some things to consider as you evaluate sufficiency include: trustworthiness, collection burden, ease of interpretability, relevance to intended goals.
Data Source | Benefits of including within an accountability system | Drawbacks or potential harms of including within an accountability system | Should we include this data source within our local accountability system? (Yes/No) |
| | | |
| | | |
Reflect:
Step 5: Review the Model
Complete the table below that focuses on each stakeholder group within the local accountability system. The table is designed to help focus on the reciprocity built into the system design, how is each user contributing to the success of the program? How are the needs of each user being met by the program?
Stakeholder Group | How is this user group contributing to the success of the program and the associated accountability system? | How are the needs of this user group being served by the program and the associated accountability system? |
Students | | |
Educators | | |
Administrators | | |
Caregivers | | |
Public | | |
Reciprocity
Activity 5:
Elevating the Local Accountability Prototype
At the end of this activity, our coalition will have…a series of policy recommendations stemming from our prototype experience.
Step One: Revisit the Prototype Data
(10 Minutes)
Let’s briefly reflect on the implementation and impact data collected during prior modules.
Step Two: Revisit the Current Accountability Policy
(10 Minutes)
Step Three: Considering Policy Implications
(30 Minutes)
Imagine that KDE adopted your L3 prototype and embedded it into the statewide accountability system exactly as it is.
How would accountability policy need to change in order to successfully adopt your prototype?
Are there any unintended consequences that could come from a statewide adoption of your prototype?
Step Four: Creating a Narrative
(30 Minutes)
Imagine that all of your policy recommendations have been adopted exactly as you stated them above.
What would the world look like?
Divide into three groups and briefly narrate how the system looks and feels to each of the stakeholders identified in the United we Learn report.
Gut Check & Reflection
Activity Wrap-Up