1 of 25

Action Plan B Workshop:�Using Data to Create Measurable Goals

May 16, 2024

2 of 25

Click on the link in the chat and navigate to slides 3-5 to say hi! Fill in:

Name
County office (or organization)
Role
What is the focus of the goal you hope to make the most progress with this year (e.g., middle school math PL, the computer science teacher workforce, the science dashboard)?

Welcome!

We’re so glad you’re here!

3 of 25

Name Add a row if needed!	COE or Organization	Role	Goal Content Focus
Lisa Le Fevre	WestEd	Research Manager	Supporting as evaluator and here to learn from you all! (S, M, CS)
Dana Thompson	Ventura COE	Director Ed Tech	CS
Anthony Quan	Los Angeles COE	STEM Science Coordinator	Teacher Leadership; Inquiry Driven Pedagogy
Renée Marcy	San Francisco	Supervisor for Science	Science & Math
Deb Atwell	LACOE	STEM Math Coordinator	Teacher Leadership Inquiry driven pedagogy
Marian Murphy-Shaw	SCOE (Siskiyou)	Educational Services Director	M, S, CS
Lilibeth Pinpin	Solano COE	Director	Science
Kia Barrieau	Tuolumne CSOS	Math Coordinator	Sustained Teacher PD

4 of 25

Name Add a row if needed!	COE or Organization	Role	Goal Content Focus
Bella Githere	San Joaquin	STEM Coordinator	Science
Joanne Tucker	Trinity	Instructional Support Specialist	Math and computer science
Lizzy Hull Barnes	San Francisco	Supervisor	Mathematics and Computer Science
Cecilio Dimas	Silicon Valley Math Initiative (SVMI)	Executive Director	Math
Gini Vandergon	CSU Northridge	Director of the SFVSP	Science
Maria Simani	UC Riverside	California Science Project	Science Professional Learning
Marie Rohl	SiskiyouCOE	Instructional Coach	Coaching, Developing MSCS Team
Melanie Janzen	San Bernardino County Superintendent of Schools	Curriculum Coordinator	Deeper content learning for teachers

5 of 25

Name Add a row if needed!	COE or Organization	Role	Goal Content Focus
Tracy McManus	Contra Costa COE	STEAM Coordinator	Integration ideas
Sherry Rodgers	Shasta COE	Math and STEM Coordinator	Math, Science and Comuter Science
Jared Amalong	Sacramento COE	Director, Computer Science and Digital Learning	Integration of the CS standards with middle school math and science standards
Priscilla Rice	San Bernardino County	Math Coordinator	Integration of MSCS
Zachary Pettitt	Orange County	STEM Coordinator	Growing our CS community
Amy Kraft	Sacramento COE	Curriculum Specialist, Science
Delgel Pabalan	San Joaquin COE	STEM Coordinator	Integration of MSCS, admin support, creating a STEM identity
Summer Belloni	Solano COE	Program Manager
Jamie Garner	Stanislaus COE	Math Director	Local COPs for Math, Science and Computer Science
Satinder Singh	San Joaquin COE	Director of Math	Integration and STEM identity

6 of 25

Name Add a row if needed!	COE or Organization	Role	Goal Content Focus
Vicki Vierra	Ventura COE	Math Coordinator	Introduction & Implementation of CA Math Framework, Coordination of PL experiences with our Partner groups
Josue Gaona	Monterey COE	Program Specialist
Sarah Lundy	WestEd	Program Manager	Supporting goal development!
Kristy Warren	Contra Costa COE	Director, C & I
Ma Bernadette Salgarino	Santa Clara COE	Asst. Director, iSTEAM	Plans to integrate CS, Math and Science; goals to integrate these with other content areas such as ELA/ELD.

7 of 25

Lauren Aranguren

CAL-MSCS Math Lead

Santa Barbara County

Co-Host and Facilitator

Dr. Lisa Le Fevre

Research Manager

WestEd

Facilitator

Dr. Sarah Lundy

Senior Program Manager

WestEd

Facilitator

Dr. Stacy Marple

Senior Research Associate

WestEd

Co-Host and Facilitator

Maria Salciccioli

Senior Research Associate

WestEd

Co-Host and Facilitator

Megan Smith

CAL-MSCS Science Lead

San Joaquin County

Co-Host and Facilitator

CAL-MSCS

Hosts & Panelists

Hosts &

Facilitators

8 of 25

Welcome, Intros, Objectives (5 min)

The M in SMART Goals (10 min) Breaking down an Action Plan B example

Agenda

Discussion: Common Data Collection Pitfalls (15 min) Whole group discussion, examples, and Q&A

Working on APB goals (25 min)

Working in groups of 2-5 COEs, with facilitator support

Closing, Next Steps (5 min)

9 of 25

CAL-MSCS Goals

Workshop Objective(s): To support the creation of measurable goals for Action Plan B.

In this workshop, participants will:

Learn

How to address the “M” in SMART goals - measurable!
Different ways of collecting data

Explore

Best practices around choosing data collection methods
How to connect data collection methods to questions
Data COEs may already have that could help answer your questions

Practice

Writing measurable goals
Testing whether your goal is measurable

Session Goals & Outcomes

10 of 25

Participation Guidance

Center inquiry and curiosity
Actively engage with others during the session
Share the air
Take care of your needs - ask questions, stand, stretch, etc.
Use chat for clarification questions

Participation Guidance

11 of 25

Sample SMART goal from the Action Plan B guide:

By Winter 2024, our county will create new collaboration or deepen engagement with at least two local content area partners to create capacity and materials that support teacher professional learning opportunities in math, science, and computer science in grades 4-12. Effective collaboration and engagement will be demonstrated through a partner engagement framework that measures the depth of shared relationships and work.

Breaking Down a Measurable Goal

11

12 of 25

CAL-MSCS Goals

By Winter 2024, our county will create new collaboration or deepen engagement with at least two local content area partners

List the new partners and what the collaboration looks like: scope of work? Outcomes?

List old partners and describe: has engagement deepened, lagged, or stayed the same?

to create capacity and materials that support teacher professional learning opportunities in math, science, and computer science in grades 4-12.

What professional learning opportunities were provided in MSCS this year for 4-12 teachers?

How was capacity built? How do you know?

Are these new materials? If not, were they updated or changed?

Effective collaboration and engagement will be demonstrated through a partner engagement framework that measures the depth of shared relationships and work (e.g., number and types of professional development materials created, commitments made and achieved, partner experiences of creating and implementing local professional learning as captured by surveys/interviews).

Slide 2 - breaking the goal down

13 of 25

CAL-MSCS Goals

Breaking Down a Measurable Goal - cont.

By Winter 2024, our county will create new collaboration or deepen engagement with at least two local content area partners to create capacity and materials that support teacher professional learning opportunities in math, science, and computer science in grades 4-12.

Effective collaboration and engagement will be demonstrated through a partner engagement framework that measures the depth of shared relationships and work.

If capacity allows, you could use a partner engagement framework to help understand the data collected in the first part of the goal.

14 of 25

CAL-MSCS Goals

What stuck out to you in this process?
What resonated?
What questions do you still have?

Questions and Reflections

15 of 25

We’ll move you into a room with your team, a few other COEs, and a facilitator

You’ll have ~20 minutes to work on making your goal measurable.

Breakout Rooms

Link to our workspace: Here

16 of 25

We heard a lot of really good ideas in the breakout rooms - take a moment to read through the notes (link here).

What resonates?

Super Quick Share

What Works?

Share Broad “Aha’s!”

17 of 25

In the chat: tell us about a data collection experience you had- as a collector or a participant

Super Quick Share

Data Collection

18 of 25

CAL-MSCS Goals

Overall

Making sure EVERYTHING, design to dissemination, is tightly aligned to the inquiry question/goal of the data being collected
Limit use of AI - remember, AI is a pattern seeker, it cannot reason

AI is a smart high schooler being asked to do graduate work - check and recheck anything you use it for

Backwards design with an eye for time/resources

Often, more data is collected than there are resources to make meaning or share meaning from!

Use established tools/get help from professionals

Our idiosyncratic questions are great for exit tickets - not surveys!

Data Collection Best Practices

19 of 25

CAL-MSCS Goals

Design

Surveys with… two part questions, long scales, too many questions, questions that aren’t useful
Focus groups that are too similar
Lack of diversity in participants

Collection

Planning for participants who cannot/ are not able to participate
Over collecting/ Under collecting

Analysis

Confirmation bias
Cherry picking data
Overgeneralizing from a specific/limited scope/limited number sample

Dissemination/Sharing/Applying

Forgetting to share results back to participants
Not acting on results

Data Collection Pitfalls

20 of 25

CAL-MSCS Goals

Top Takeaways

Don’t drown in data
Hold your feet to the fire of your goal
Resist spicy data’s siren song

21 of 25

CAL-MSCS Goals

Let’s Practice - Post-Session Survey

First, complete our (quick) survey - link in the chat
Then, let’s discuss:

How did it feel to complete the survey?
What did you think about?
What did you learn?

Sourcing survey items

22 of 25

CAL-MSCS Goals

CAL-MSCS: Asset Mapping Process

Action Plan A	Action Plan B
Assets and Needs	Identifying Goals to Improve PL Systems
Initial Partner Outreach	Using Assets (leveraging what works; building a team!)
Specify Actions to be Taken to Develop Goals	Actions and Activities to Assess Progress

23 of 25

Reflection and Action: Accountability Check

Use the next slide to share your thinking

(3 min)

Might a brave soul want to share a thought aloud (1 min)?

How will this discussion inform your Action Plan B goals and future plans?
What is something you would like more information on?

24 of 25

Next Steps

Action Plan B goals and budgets due by June 30

Reach out any time! Follow us:

Instagram: @calmscs

Facebook: California Mathematics, Science, Computer Science Partnership

25 of 25

We Appreciate Your Time!