Evaluation and Your Diabetes Strategy Part 2

July 25, 2022

Welcome! Please introduce yourself.

• Please share in the chat:
• Name
• County

​

Save the Date

• Accelerating Oral and General Health for All through Health Literacy: A Symposium and Tribute to Dr. Alice M. Horowitz September 16th from 10:00 am - 3:00 pm. In-person & virtual.
• Health Literacy in Action Conference October 13th-14th. Virtual.

Reminder

• You can find a template for the Diabetes Strategy Implementation & Evaluation Plan on our website.

Agenda

• Maryland Diabetes Action Plan 2020 Benchmark Review
• Evaluation and Your Diabetes Strategy - Dr. Dyer
• Update on TA - Pam Williams
• Q&A

 Evaluating Your Diabetes Strategy�Part II: �INCREASING AWARENESS!!!

Monday, July 25,2022

By 2024, 32% of Maryland adults will be healthy weight

By 2024, maintain percentage of adults with BMI>25 at 66.5 percent

By 2024, increase the prevalence of Maryland adults who know their prediabetes status by 30 percent��

• As of 2018 data, 12.8% of respondents stated they were told they were either borderline for diabetes or had prediabetes. An additional 1.1% were only told during pregnancy.

​

• As of 2020 data, 14% of respondents stated they were told they were either borderline for diabetes or had prediabetes. An additional 1-2% were only told during pregnancy.

​

• WE WANT 44%!!!!

​

​

• Effective program evaluation is a systematic way to improve and account for program actions involving methods that are useful, feasible, ethical, and accurate.

​

• An evaluation framework is CRITICAL to summarize and organize essential elements of program evaluation.

​

• The framework comprises steps in evaluation practice and standards for effective evaluation.

Steps in Evaluation…where do you fall?

• What will be evaluated? (i.e. what is "the program" and in what context does it exist)
• What aspects of the program will be considered when judging program performance?
• What standards must be reached for the program to be considered successful?
• What evidence will be used to indicate how the program has performed?
• What conclusions regarding program performance are justified by comparing the available evidence to the selected standards?
• How will lessons learned from the inquiry be used to improve program effectiveness.

Steps in Evaluation…BEFORE YOU BEGIN

Program Evaluation

EVERYONE has a ROLE

• Aggregate Data
• State Level (BRFSS)
• Ecological Fallacy
• WHAT DOES YOUR COUNTY’S ESTIMATES REVEAL???
• Without this knowledge then how do we KNOW we have reached our benchmarks and goals?

​

DATA

Evaluation Is Thought To Be Evaluation Can Be

Expensive ................................... Cost-effective

Time-consuming ......................... Strategically timed

Tangential ................................... Integrated

Technical .................................... Accurate

Not Inclusive .............................. Engaging

Academic ................................... Practical

Punitive ...................................... Helpful

Political ...................................... Participatory

Useless .......................................Useful

EVALUATION DOESN’T HAVE TO BE ELUSIVE

Logic model template and background

Logic models are visual representation tools for planning, describing, managing, communicating, and evaluating a program or intervention.

​

They graphically represent the relationships between a program’s activities and its intended effects.

​

They state the assumptions that underlie expectations that a program will work, and frame the context in which the program operates.

LOGIC MODEL

Logic models increase the likelihood that program efforts will be successful because they:

• Communicate the purpose of the program and expected results
• Describe the actions expected to lead to the desired results
• Become a reference point for everyone involved in the program
• Improve program staff expertise in planning, implementation, and evaluation
• Involve stakeholders, enhancing the likelihood of resource commitment
• Incorporate findings from other research and demonstration projects
• Identify potential obstacles to program operation so that staff can address them early on

LOGIC MODEL

DEVELOPING YOUR OWN LOGIC MODEL

LOGIC MODELS

LET’S “CHAT” ABOUT IT!!!!!

​

​

​

​

APPENDICES

Maryland Diabetes Action Plan 2020

Maryland Diabetes Action Plan 2020

Maryland Diabetes Action Plan 2020

a

Healthy Weight

1,529,271¹

Overweight and Obese

3,200,498¹

Statewide Integrated Health Improvement Strategy Goal:

Through 2026, achieve a more favorable change from baseline mean BMI than a group of control states

Diabetes and Diabetes Complications

481,290¹

Diabetes Action Plan Goal:

By 2024, reduce the age-adjusted diabetes mortality by 5 percent.

Prediabetes

1,828,581^1,2

Outcomes-Based Credit Goal:

Through 2026, increase the number of averted cases of diabetes (difference in diabetes incidence rate between Maryland and a group of control states)

^1. US 2020 Census

^2. Centers for Disease Control and Prevention. National Diabetes Statistics Report, 2020. Atlanta, GA: Centers for Disease Control and Prevention, U.S. Dept of Health and Human Services; 2021

Note: Underweight population isn’t included: 82,286 is the underweight population

Maryland Adult Diabetes Target Population and Goals

CDC Estimates

• Estimates from CDC statistics report, based on clinical A1C data (typically combined 4 years of data); this is generally applied to census figures to get state estimates.
• Increase in Marylanders getting diagnosed with prediabetes
• OVERALL STATEWIDE GOAL IS TO REDUCE PREVALENCE OF DIABETES!

​

​

​

Update on TA