1 of 25

1

Institutional Team Breakouts:

Learning and Scaling Student Success

​

Louise Yarnall, SRI Education

May 24, 2022

2 of 25

Workflow for Institutional Team Planning

2

Your ideas

    • Align ideas from virtual session to First2 Driver Diagram

First2’s practices & metrics

    • Address gaps in your plan by selecting more from First2 menu or high-impact practices

Develop 22-23 plan

    • Use First2 planner to select/assign high-impact practices

3 of 25

Introduction to “Improvement Science”

  • A way for practitioners to:
  • Learn together
  • Refine their practices based on data
  • Share insights with fellow practitioners
  • Improve institutional systems

​

3

4 of 25

Consistent Focus on Practice Improvement

4

Act

​

Adapt, Adopt, Abandon

Plan What is your change idea, prediction & measurement plan?

​

Do

Execute test, collect data, and document observations.

​

Study

Compare results and determine what you have learned.

5 of 25

How system-change happens with improvement science

5

Macro level

​

​

​

Meso level

​

​

​

Micro level

6 of 25

A Model for Improvement

6

Define the problem

Refer to the First2 Driver Diagram

Identify high-impact practices (change ideas)

​

Plan/conduct tests of high-impact practices (PDSA cycles + metrics)

Use & share data to refine high-impact practices

Set the problem

​

​

​

​

​

​

​

​

Develop a theory of how to improve the system

​

​

Test the theory and practices associated with it

7 of 25

A Model for Improvement: Virtual convening

7

Define the problem

Refer to the First2 Driver Diagram

Identify high-impact practices (change ideas)

​

Plan/conduct tests of high-impact practices (PDSA cycles + metrics)

Use & share data to refine high-impact practices

8 of 25

A Model for Improvement: Yesterday’s work

8

Define the problem

Refer to the First2 Driver Diagram

Identify high-impact practices (change ideas)

​

Plan/conduct tests of high-impact practices (PDSA cycles + metrics)

Use & share data to refine high-impact practices

9 of 25

A Model for Improvement: Today’s work

9

Define the problem

Refer to the First2 Driver Diagram

Identify high-impact practices (change ideas)

​

Plan/conduct tests of high-impact practices (PDSA cycles + metrics)

Use & share data to refine high-impact practices

10 of 25

How to study high-impact practices at your institution

  • Finalize a list of the high-impact practices to try in 2022-23
  • Recruit and engage one or more practitioners in using each of these practices (e.g., faculty, students, student services, etc.)
  • Guide the practitioners using these practices to test them with common metrics
  • At a minimum, all practitioners should gather some data on “process” and “outcomes”
  • The First2 Improvement Science Team provides a set of tools for you to use: https://first2network.org/pdsa-resources/
  • Each institutional team needs to share these tools with its practitioners and guide them in gathering data and sharing their insights back to the network.

10

11 of 25

First2 PDSA Website

11

12 of 25

“What are PDSA Cycles?”

​

  • PDSA cycles are evidence-based. We make decisions based on measurable, reproducible data.

​

  • PDSA cycles are rapid tests of change. We try new things, assess how they work, make “good decisions quickly” rather than “perfect decisions never.”

12

Look at this later (not now!): For each High-Impact Practice, your institutional team will submit to First2 a PDSA Template: https://tinyurl.com/3355ajva

13 of 25

What the template requires

13

Describe change Idea and give a title to your PDSA Cycle

Link to the primary/secondary drivers from First2 Driver Diagram

Enter one or more learning questions for your testing cycle

Make one or more predictions for each learning question

Describe how practitioners will implement the test

Describe supports and processes for gathering test data, storing it, analyzing it, and acting on results (Adapt, Adopt, or Abandon?)

Describe your required supplies, materials, and resources

14 of 25

Tools for Completing the PDSA Templates

  • First2 has existing documentation its core high-impact practices in the menu, you may cut and paste into the PDSA template: https://tinyurl.com/2xch9bpz
  • Coming soon! A full list of suggested metrics for each core First2 high-impact practice: https://tinyurl.com/yc773ysn (Measurement Menu Idea tab)
  • Coming soon! We also will set up a Google Folder with existing, shareable measurement instruments.
  • Coaches! Yes, once you submit your template, the Improvement Science Team will review and help you!!

​

14

15 of 25

Example Metrics for PDSA Cycle around First2 High-Impact Practice

15

Revised Change Idea Title

"Must Measure" Process Measures

"Must Measure" Outcome Measures

Useful Measurement Extensions

Metacognition: Faculty PD to Support Student Metacognition

1. Faculty attendance at the PD session, including faculty contact information for follow up.��2. Follow up tracking (ex: periodic surveys, faculty meeting check-ins) with attendees to measure which strategies they employed (if any) and how often.

1. Student course completion (ex: starting student roster compared to ending student roster).��2. Student pass rate and/or course grades of those who completed.

* Comparing student course completion, pass rate, and/or course grades to other instance of the same course (ex: same course taught by instructor in a different term, same course taught by a different instructor).

16 of 25

Activity: Explore the First2 PDSA Support Tools

  • Step 1. As a team, gather around a shared computer
  • Step 2. Go to the following links:
  • Step 3. Review and discuss:
    • Can you navigate the First2 PDSA tools well?
    • What help do you need?
    • How do you think your team can arrange to get the PDSA templates completed?
    • Prepare to debrief the whole group

16

WiFI: Stonewall1082

17 of 25

Discussion

• Each institutional team will share its responses:

    • Could you navigate the First2 Tools well?
    • What help do you need?
    • How do you think your team can arrange to get the PDSA templates completed?
  • Any other questions and concerns?

​

17

18 of 25

Next steps

• Today 3– 4:30, Next Steps for Institutional Teams

​

18

19 of 25

Extra

19

20 of 25

Menu

20

21 of 25

Menu

21

22 of 25

Driver 1 Review

22

 

23 of 25

Driver 2 Review

23

 

24 of 25

Driver 3 Review

24

 

25 of 25

Driver 4 Review

25