CAELI County Office of Education (COE) Fellowship

December Workshop 2023

Data and Impact

Welcome and Overview

​

3

Land Acknowledgement

In the News:

U.S. touts new era of collaboration with Native American tribes to manage public lands and water (AP News December 7, 2023). At an annual gathering with tribal leaders this week, the Biden administration announced 200 new agreements to support federal co-stewardship with tribes.

A new online clearinghouse of sovereign-to-sovereign agreements is now available here.

4

Land Acknowledgement

For more resources visit:

Native Governance Center’s Beyond Land Acknowledgement Series

​

SMCOE ELSI Land Acknowledgement Resources

​

And Look-Up Native Land You Live and Work on at: https://native-land.ca/

Welcome from Facilitators and Sponsors

Andra Yeghoian, MBA

Chief Innovation Officer

Ten Strands

ayeghoian@tenstrands.org

Amy Frame, Ed.D.

Director of Strategic Partnerships

Ten Strands

aframe@tenstrands.org

Amity Sandage

Environmental Literacy Coordinator

Santa Cruz COE

asandage@santacruzcoe.org

CAELI COE Fellowship Goals

Build COE staff capacity for developing and implementing county-wide high impact environmental literacy and sustainability initiatives.

A fellow is a member of an academy or group who work together in pursuing mutual knowledge or practice, and/or support the development of a new project or initiative.

Community Building Activity

​

What words come to mind when you think about metrics and data?

ⓘ

Click Present with Slido or install our Chrome extension to activate this poll while presenting.

Community Building Activity

With a partner:

​

• Discuss how you feel about data and metrics in general?

​

• Share the example of how you use data in your work already.

​

​

Workshop Overview

​

Today’s Focus

Measuring and Reporting Impact

• Metrics: measures of quantitative and qualitative assessment commonly used for assessing, comparing, and tracking performance or impact.

​

• Impact: measuring the effect of projects, programs, networks, and services

​

• Data: facts and statistics collected together for reference and analysis.

Key Focus Areas and Entry Points

• Big Data Indicators: Using data indicators from your county to understand the big picture and explore possibilities for partnerships, identifying champions, and getting different projects and services started.

​

• Diving Deeper on Regional Data: How to collect more detailed data on specific data points to develop specific projects, programs, and services. Examples of data sets: school gardens, green clubs, campus infrastructure (energy, waste, etc.), community based partners, etc.

​

• Measuring Impact of your COE Programs and Services: Understanding how to collect data about the impact of your programs and sharing that impact with your COE supervisors, funders, and the broader community.

Activities Agenda

13

• Welcome and Community Building

​

• Framing Metrics and Impact

​

• Exploring Your County Level Data

​

• Diving Deeper on Local Data For Your County

​

• Measuring Impact for Your Programs, Networks, and Services

​

• Application: Coming Back to Your Plan

​

• Closing and Exit Ticket

Big Data Indicators from Your County

Overview

This segment is about understanding how to use big picture data indicators that provide a snapshot of environmental and climate action within the county both for school communities and the broader county and municipal jurisdictions.

History of Big Data Indicators for One County

“Going to Scale” in San Mateo County

• Data Need - SCALE: Understand “Scale” for San Mateo County School Districts
• Data Need - EQUITY: Understand Equity as it relates to traditional education indicators, and pair that with environmental pollution:
• If every district knocked on my door on the same day who would I help?
• Who should I reach out to first, and keep coming back to even if they say no the first time or first few times.
• Data Need - PROGRESS: Identify the indicators that demonstrate Environmental and Climate Action in Campus, Curriculum, Community and Culture
• Initiative Need - COMMUNICATIONS: Set up pathways for making data accessible to SMCOE, districts, and community based partners (CBPs).

https://sites.google.com/smcoe.org/smcoeelsidatadashboard/home

​

At the Statewide Level the Needs Are Similar!

Statewide Challenge: We are trying to go to scale in every county, but the only publicly available data for identifying environmental and climate action is the CA Green Ribbon Program…only 1-3% of schools and districts have participated…

Data Initiative for Environmental and Climate Action in California’s TK-12 Schools

www.cde.ca.gov/ls/fa/sf/greenribbonprog.asp

Little to No Data Available on Green Schools and Environmental Literacy

Solution: Develop an Equity Informed Database

• Data Set 1: Understand “Scale” in California’s TK-12 Education System

​

• Data Set 2: Understand Equity as it Relates to Need and Environmental Pollution

​

• Data Set 3: Data Set to Understand the role of Broader Context Factors (at the county level) as either barriers or opportunities for different regions in California.

​

• Data Set 4: Data Set with Indicators that Demonstrate Environmental and Climate Action in 4Cs

Data Initiative for Environmental and Climate Action in California’s TK-12 Schools

We are Creating the Database now!

Data Project Website: https://sites.google.com/tenstrands.org/ca-envlit-scrs-data-project/home

Scaling implementation requires an equity-informed, data-driven approach that prioritizes underserved communities and addresses environmental injustices…

Activity: County Summary Data Review and Discussion

Explore the data for your County:

• What did you find most interesting?
• What questions do you have?
• What is your analysis about the progress in your county based on the data that you have and the summary analysis template for section 4?
• How would you go about validating the data?
• How would you use this data to advance your environmental initiatives?

County Data (use tabs along bottom for each county)

​

Section 4: Template and Orange County Example

Come Back at: 10:05

Diving Deeper on Local County Data

Overview and Questions

This segment is about understanding how to collect more detailed data on specific data points across the districts and schools in your county to develop specific projects, programs, and services.

​

• What data might be good to get started with?

​

• What are the methods for collecting, cleaning, and analyzing this data?

​

Give a Data Set Prototype to React to Instead of Starting with a Blank Slate Survey

Digital Surveys for District and Schools are a tough sell…and in many cases are not allowed. When you can do a survey, use paper surveys that people can fill out in five minutes during a convening at your COE

We just explored data that you can find publicly and make visually compelling:

• Demographic Data
• Facilities Master Plan
• Bond measures
• Board Policies
• Pollution Burden
• Green Ribbon

​

We can also gather customized data from:

• Site visits
• 1-1 conversations
• Call front desk
• Community Partner Data
• Offices of Sustainability
• Youth Action Projects
• Google Earth

Example: Emerging Green Model Elementary Schools

Recurring Question from Administrators: Is there a model school I can look at as an example of a Green School?

​

Model Green Elementary Schools Meeting: Simple gathering to share data. Shared indicators in agenda and invited schools to review and add.

Data was available from:

• Green Districts Working Group registration
• PL Program Rosters
• Teacher Action Projects
• Green Schools partner database and outreach
• District newsletters
• Youth-led survey
• Garden Community Based Partners

​

Data categories:

• School/District Participation in PL Programs
• Three Stream Waste Implementation
• Ocean Guardian Schools status
• Green Schools status (county program)
• Green Classroom Challenge participation
• Solar Installation
• Student Eco Clubs
• School Garden

​

Tips for Gathering Local Data

Tips for Success:

​

Embed data sharing into program or meeting registration Green Schools Working Group example

​

Have a set of questions ready for use at every meeting with site or district leaders and add responses to spreadsheet afterward

​

When presenting to networks, give a paper survey to gather data

Data Sources and Partners

• District or School Committees
• Admin and Teacher Networks
• Youth Action Networks
• Green School Certification Programs
• District Newsletters
• CBP Relationships

San Mateo County Example of CBP EE Provider Data

Early days of Network were about understanding what each partner does, and who they are serving

Once we landed on the goal of every student at every grade level getting experiences, our focus on data became really critical

San Mateo County Example of CBP EE Provider Data

Measuring Impact for Your Programs, Networks, and Services

Driving Questions for This Segment

• How might you measure the impact of your programs, networks, and services, and what data can you collect to do this?

​

• How can design your data systems to be equity informed?

​

• How can you design your data systems to be equity efficient and effective, and for internal and external use?

​

• What are strategies for sharing your impact with others, and why might you want to share this impact?

Program Impact

Measuring Impact of Programs: Quantitative

• # of Participants and their demographics
• Collective impact from actions related to your programs: 1) How many students or people did participants reach with their action? 2) Any specific ecological impact data (ex: GHG emissions saved, pounds or tons of waste saved, etc.)

Examples

• SMCOE Teacher Fellowship Spreadsheet
• SMCOE Awards Program Tracking
• San Mateo County Youth Climate Ambassadors Spreadsheet
• Santa Cruz COE Teacher Leadership Institute Data Snapshots
• Santa Cruz COE Examples of Impact Tracking Working Docs

Focus is on gathering data about participants, their equity related demographics, and their impact

Measuring Impact of Programs: Qualitative

Focus is on gathering data about participant experience

Examples

• Program Surveys
• Participant Case Studies
• Testimonial Quotes and Interviews

Sharing Program Impact with Others: Report Style

Interested Audiences

• Supervisor
• Funders
• District and School Leaders
• Recruiting Data for Future Participants
• Researchers
• Replicators in other counties and districts

Resource Examples

• Teacher Fellowship Report: 2020-21 and 2021-22
• Formal Evaluation Report: 2015 - 2021
• Admin Fellowship Report: 2020 and 2021
• YCA Program Reports: Cohort 2 and Cohort 3
• Awards Program Reports: 2019-20 and 2021-22
• Annual Reports: See Three Years in Google Drive Folder

Sharing Impact Stories: Inspiring Changemakers

Tips and Tricks for Archiving Examples

• People want compelling stories more than they want unit plans or project plans
• Spreadsheet that you can use for both quantifiable data and for archiving examples
• Archive a PDF or Word Doc version that your organization can own…
• Easy to share via email and Newsletters
• Organizing Framework for website archive: Topic, Place, Role, graduation year, etc.

YCA Spreadsheet

YCA Webpage

SMCOE Changemakers Page

SMCOE Sustainability Toolkit

Award Spreadsheet

SMCOE ELSI Newsletter

Supporting Changemakers to Gather Data

Include a session on Capturing Impacts and Data

• Example slides from Santa Cruz COE Teacher Leadership Institute for Sustainability
• 1.5 hour afterschool zoom session in the middle of the program before project implementation begins
• Assessing impacts in three areas
• Provides template surveys and tools

Services Impact

Tracking Services Provided

As staff increased and demand for services increased it became necessary to develop systems for tracking services provided and summarizing time spent with each district - there were no centralized processes for this at SMCOE so we built out a model for the COE

Demand Increased Over Time for Services

General trend towards an increase in services over time - disruption in 2020-21 from COVID, but still an increase over time since 2017-18

Using Data to Understand Importance of Relationships

Increase of relationship at the district-level as initiative progressed

Correlation between Staff Turnover and Request for Services

Resource Considerations

Tracking Resource Development and Audience Interest

Mailchimp Newsletter helped to track open rates and resources that people click on

Annual Report Helps Gauge Time Spent on Resource Development

Ten Strands/CAELI PDF and Trackable Links

Coming Back to the Big Picture

Initiative Annual Reports

As your initiative grows it can be helpful to pull all this impact data together into an annual report. Audiences for this report include the following:

• You and your colleagues
• Your supervisors
• Funders
• District and School Leaders in your County
• CAELI

See example links in notes

Breakout Room Reflection Time

• What resonated with your context and situation at your COE?

​

• What strategies seem most relevant to the ideas you have (or efforts you have started) for environmental literacy and sustainability work in your county?

​

• What resources do you want to explore further, and what questions do you have that could be answered today or in the future?

Pro Tips for Long-Term Data System Success

• Design system for entry-level data users to be able to contribute and maintain datasets, and for interim use by short term interns and staff - Create a data process overview AND data formatting guideline - use 1s and 0s for numerical data instead of Yes and No

​

• Have a primary data spreadsheet that you update annually so that it is easy to update all other sheets.

​

• Separate out current email contact lists from archived lists - and DON’T delete archive records of program participation if email becomes inactive or schools close.

​

• Have an “All Cohort” or “All Years” data sheet to check for duplicated participation

​

• Use google sheets instead of excel so multiple collaborators can enter data

​

• Decide if you want data to be filterable and interactive or static reports

Come Back at: 11:10

Planning and Coaching

ALL FELLOWS

Activity: Planning Time! 20 minutes

Individual County planning time - The following questions have been added to your work book under each pillar’s planning section:

• Programs: What data or metrics can demonstrate progress or measure impact of my initiative?
• Equity: How can data and metrics demonstrate benefits to historically marginalized students?
• Partners: Who might I partner with for data and metrics?

ACTION STEPS:

What are the first steps to be taken to advance data and metrics in my plan?

Folder with workbooks

Activity: Peer Sharing - 10 minutes

ACTION STEPS:

What are the first steps to be taken to advance data and metrics in my plan?

Share your thoughts from your planning time with a partner from another county office:

• Programs: What data or metrics can demonstrate progress or measure impact of my initiative?
• Equity: How can data and metrics demonstrate benefits to historically marginalized students?
• Partners: Who might I partner with for data and metrics?

Folder with workbooks

Closing and Reflections

Reflection Time

• What are your key takeaways about the importance of data and impact metrics to implementing a successful initiative?
• What commitments are you considering integrating data and impact metrics into your environmental literacy and sustainability efforts?

Exit Ticket

Updated 12/7/23

Updated 12/7/23