Evaluating the Effectiveness of
a Comprehensive Social Marketing Campaign:
Drink Water, Georgia!
Emily Simpson, MPH, CPH | Evaluation Coordinator
Edda Cotto-Rivera, MPH, CHES® | Project Coordinator
Tristen T. Webb | Social Marketing Coordinator
Vibha Bhargava, PhD | Evaluation Specialist
Jung Sun Lee, PhD, RDN | Principal Investigator
University of Georgia Supplemental Nutrition Assistance Program Education
(UGA SNAP-Ed)
ASNNA Virtual Conference
March 14, 2024
UGA SNAP-Ed | Focus on Healthy Beverages
UGA SNAP-Ed Grant (PI: Jung Sun Lee) since 2013
SNAP-Ed Toolkit, Food Talk: Better U: https://snapedtoolkit.org/interventions/programs/food-talk-better-u/
UGA SNAP-Ed Video Series: https://foodtalk.org/en/videos?playlist_id=PLaxkL2FcJGdbZhILIQsrlG9cLX5jO1CCl
2
UGA SNAP-Ed | Drink Water, Georgia!
3
FFY2023 Drink Water Georgia! | Evaluation Indicators
Evaluation | Key indicators | Print Media | Mass Media | Online Media | Texting/Electronic Media | |||
Newspaper | Retailer Ads | Google Ads | Website and Blog | Meta | Other Social Media Pages* | Cell phones | ||
Process | Impressions | Total newspapers circulated | Times retailer ads were seen | Views of any Google Ads content | Total page views | Views of any content on Facebook | Views of any content on other media | Total number of text messages sent |
Unique Individuals | Total newspaper subscribers | Individuals who saw the retailer ads | Individuals who viewed content | Individuals who visited site | Individuals who viewed content | Individuals who viewed content | Total text message recipients | |
Dose | Frequency of receiving newspapers | Frequency of retailer ads views | Frequency of views | Frequency of visits | Frequency of views | Frequency of views | Frequency of receiving texts | |
Engagement | | | Clicks | Visits to the site and pages | # Likes, shares, comments, etc. | # Likes, shares, comments, etc. | Replying to a text message or clicking a link in the text message | |
Market Penetration | % eligible pop. reached | % eligible pop. reached | % eligible pop. reached | % eligible pop. reached | % eligible pop. reached | % eligible pop. reached | % eligible pop. reached | |
Participant Reception | Survey | Survey | Survey | Content comments | Content comments | Content comments | Focus groups and interviews | |
Outcome | Intention/ behavior | Survey | Survey | Survey | Survey | Survey | Survey | Text-based survey |
Impact | Intention/ behavior (including control counties) | EDDM Survey | EDDM Survey | EDDM Survey | EDDM Survey | EDDM Survey | EDDM Survey | EDDM Survey |
4
FFY2023 Drink Water, Georgia | Evaluation Measures
Measure | Survey Question | Response options |
ST1l: Drink water instead of sugary beverages | During the campaign, we texted you about setting goals to reduce sugary drinks and sugar added to coffee and tea. Did you set a goal to drink less sugary drinks? | Yes, No, Not sure |
Based on seeing these advertisements and logos today...
| Strongly disagree, Disagree, Neither agree nor disagree, Agree, Strongly agree | |
MT1g: Drinking Water | Over the past few weeks, we sent you text messages about making healthy beverage choices. Are you drinking more water because of these texts? | Yes, No, I was already drinking 6-8 cups of water a day before receiving these texts |
Since seeing the advertisements, logos and/or images, have you been drinking more water? | Yes, No, Not sure | |
MT1h: Drinking fewer sugar-sweetened beverages | Over the past few weeks, we sent you text messages about making healthy beverage choices. Are you drinking fewer sugary drinks because of these texts? | Yes, No, I was not drinking sugary drinks before receiving these texts |
5
FFY2023 Drink Water, Georgia | Impact Evaluation
EDDM Assisted Surveys
6 Intervention Zip Code Areas
(5,562 EDDM Postcards Distributed)
48 Surveys Completed
(0.86% Response Rate)
6 Control Zip Code Areas
(4,466 EDDM Postcards Distributed)
65 Surveys Completed
(1.46% Response Rate)
DWG EDDM Postcard
6
FFY2023 Drink Water, Georgia | Impact Evaluation Measures
Respondent Demographics
Daily Water and Sugar-Sweetened Beverage Consumption
7
FFY2023 Drink Water, Georgia | Impact Evaluation Measures
Impact of the campaign Logos, Graphics, and Advertisements
8
FFY2023 Drink Water, Georgia | Process Evaluation Results
Evaluation | Key indicator | Print Media | Mass Media | Online Media | Texting/Electronic Media | |||
Newspaper | Retailer Ads | Google Ads | Website and Blog | Meta | Other Social Media Pages | Cell phones | ||
Process | Impressions | N/A | 293,748 | 389,451 | 43,179 | 2,572,099 | Twitter: 1,943�Pinterest: 251,046 | 28,865 |
Unique Individuals | N/A | N/A | 75,383 | 17,147 | 983,409 | Twitter: N/A�Pinterest: 151,059 | 1,918 | |
Dose | N/A | N/A | 5.16 | 2.51 | 2.61 | Twitter: N/A Pinterest: 1.66 | 15.04 | |
Engagement | | | 51,704 | N/A | 3,746 | Twitter: 1,168�Pinterest: 1,048 | N/A | |
Market Penetration | N/A | N/A | 2.51% | 0.57% | 32.75% | 5.03% | .06% | |
9
FFY2023 Drink Water, Georgia | Impact Evaluation Results
Respondent Demographics (N=113)
Impact of the Campaign Logos, Graphics, and Advertisements
Daily Water and Sugar-Sweetened Beverage Consumption
| Intervention Zip Code Areas | Control Zip Code Areas |
Daily Water Consumption (most of the time or almost always) | 64% | 62% |
Soda Consumption (often or everyday) | 11% | 15% |
Consumption of Fruit Drinks, Sports Drinks and Punch | 65% | 60% |
10
Emily Simpson, MPH | Evaluation Coordinator| ew03424@uga.edu
Edda Z. Cotto-Rivera, MPH, CHES® | Project Coordinator | ecrivera@uga.edu
University of Georgia Supplemental Nutrition Assistance Program Education
(UGA SNAP-Ed)
Thank You!
Funded by USDA SNAP-Ed Grant
11