QPR, Evaluation, TFCA Reflection +

End of Grant Reporting

​

​

May 21, 2026

Big Picture on Evaluation

Long-term Strategic Planning:

• Disease Prevalence and Distribution
• Cost-Utility 

​

• Program Evaluation: 
• Process
• Outcomes

​

Grantee-led Evaluation 

• CEPEG TA and Training 
• Curated resources for evaluation capacity-building
• Grantee online completion of templated evaluation plan  

What is evaluation?

Program Evaluation refers to…

​

..the systematic collection of information about the activities, characteristics, and outcomes of programs to make deductions about the program, improve program effectiveness, and/or inform decisions about future program development and funding.

~modified from the Center for Disease Control (CDC)

​

​

• It’s a process of measuring change
• It's how we demonstrate that our programs are doing what we intended
• It's what we use to inform future efforts, program quality improvement and expansion

​

​

Evaluation helps you tell your story: what you have done, how you affected change, and how you are changing the world!

Why does evaluation matter?

Evaluation supports sustainability planning, so you can take advantage of funding opportunities

Evaluation lets you know if you are accomplishing your goals and desired outcomes

Ensures that a program or program activity is feasible, appropriate, and acceptable before it is fully implemented.

Formative

Types of Evaluation

Determines whether program activities have been implemented as intended and resulted in certain outputs. Process evaluations can be conducted periodically by reviewing the components of the logic model.

Process

Measures program effects in the target population by assessing the progress in the outcomes that the program is to address. Evaluations, can begin with a review of the outcome components of the logic model.

Outcome

Assesses program effectiveness in achieving its ultimate goals and can be used to provide evidence for use in policy and funding decisions.

Impact

Process Data + the QPR

• Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that enables one to answer stated research questions, test hypotheses, and evaluate outcomes

​

• Process data is generally made up of time series data

​

• The QPR (quarterly progress report) is a snapshot of your project and the work done during each 3-month period
• Combined, your QPRs represent a time series of process data on your program!

​

​

The Cycle of Evaluation

Leveraging the QPR data

• It’s more than checking a reporting requirement

​

• Use the data you already routinely collect and report, to demonstrate the valuable work that you are doing in your communities

​

• Tell the story of the long-game – all the small steps become big changes over time

Today’s Agenda

1

Annual Block [All Grantees]

2

Accomplishments Summary [All Grantees]

5

4

TFCA Reflection [LPHA Grantees]

3

Evaluation Reflection [All Grantees with evaluation]

Competitive Reflection [Competitive/TA/Media Grantees]

Beyond QPR: End of Year + Cycle Reports

1. QPR
• QPR
• Annual Block
2. End of Grant Report
• Program Summary + Accomplishments
• Evaluation
• Competitive or TFCA Reflection

🡪Two Reports = Two Links (but one login ID)

​

Today’s Agenda

2

Accomplishments Summary [All Grantees]

5

4

TFCA Reflection [LPHA Grantees]

3

Evaluation Reflection [All Grantees with evaluation]

Competitive Reflection [Competitive/TA/Media Grantees]

1

Annual Block [All Grantees]

Annual Block

Yearly reporting of:

• 3 Key Accomplishments for the year
• 3 Challenges + Solutions for the year

Today’s Agenda

5

4

TFCA Reflection [LPHA Grantees]

3

Evaluation Reflection [All Grantees with evaluation]

Competitive Reflection [Competitive/TA/Media Grantees]

1

Annual Block [All Grantees]

2

Accomplishments Summary [All Grantees]

Accomplishments Summary

Thinking about the work you have accomplished during this grant cycle, please provide a brief summary of your overall progress this grant and your biggest accomplishments.

🡪 Over the whole grant cycle – think across all 3 years

🡪 This may require looking back at the success stories from your QPRs

You will have 5000 characters to describe this

Today’s Agenda

5

4

TFCA Reflection [LPHA Grantees]

Competitive Reflection [Competitive/TA/Media Grantees]

1

Annual Block [All Grantees]

2

Accomplishments Summary [All Grantees]

3

Evaluation Reflection [All Grantees with evaluation]

Evaluation : LPHA

• Select any evaluations that you conducted
• You will be prompted to answer the following for each completed evaluation.

The focus may look like this, which indicates there was not another strategy to report on here. This is fine – most grantees have 1 – 3 focus areas.

Evaluation : Competitive/TA/Media

Evaluation: All

LPHA Header: Thinking about your evaluation of [Strategy] in [Setting]:

• Briefly describe the focus of your evaluation. (You can cut and paste this from your evaluation plan).

​

• Thinking about the work you have accomplished during this grant cycle, please describe 3 of the most significant findings from this evaluation.

​

• How has your organization used the findings from this evaluation? How might these findings inform the future efforts in this field? Please provide specific examples.

​

• What, if anything, would your organization change about your tobacco work (i.e., intervention/policy focus, methods, populations of interest, etc.) moving forward because of lessons learned through this evaluation?

Today’s Agenda

1

Annual Block [All Grantees]

2

Accomplishments Summary [All Grantees]

Evaluation Reflection [All Grantees with evaluation]

3

TFCA Reflection [LPHA Grantees]

5

Competitive Reflection [Competitive/TA/Media Grantees]

4

Competitive Reflection

Thinking about the work that has been done and all that has been accomplished over the grant cycle, please reflect on your programmatic work using the following:

🡪 These questions are meant to be prompts and give direction – you do not have to answer each question explicitly

• Are there any emergent issues in the populations/programming that you serve?

​

• What new questions or opportunities do you see?

​

• What are the next steps in the work you are doing?

🡪 You will have 2500 characters to discuss this

Today’s Agenda

4

Competitive Reflection [Competitive/TA/Media Grantees]

1

Annual Block [All Grantees]

2

Accomplishments Summary [All Grantees]

Evaluation Reflection [All Grantees with evaluation]

3

TFCA Reflection [LPHA Grantees]

5

TFCA Reflection

Each LPHA did a TFCA

Need: TFCA

Nice: QPRs

This will help illustrate what was accomplished and will set up your next grant cycle.

As you review your original TFCA output and the goals you developed, please consider the following questions as guidance for your narrative:

🡪 These questions are meant to be prompts and give direction – you do not have to answer each question explicitly

• How closely did your work align with the original plan?

​

• Were you able to develop a comprehensive implementation plan that aligned with your TFCA goals?

​

• Were you able to achieve all of your intended goals/objectives based on your findings from TFCA?

TFCA Reflection

As you review your original TFCA output and the goals you developed, please consider the following questions as guidance for your narrative:

​

​

• What activities (goals) have you completed?

​

• Is there possibility for future exploration?

​

• What worked?

​

• What didn’t work?

🡪 These questions are meant to be prompts and give direction – you do not have to answer each question explicitly

TFCA Reflection

As you review your original TFCA output and the goals you developed, please consider the following questions as guidance for your narrative:

​

​

• What activities (goals) are still in progress?

​

• What challenges have you experienced around these activities?

​

• What successes or progress have you experienced around these activities?

🡪 These questions are meant to be prompts and give direction – you do not have to answer each question explicitly

TFCA Reflection

As you review your original TFCA output and the goals you developed, please consider the following questions as guidance for your narrative:

​

​

• What is different from your original plan or had to be changed in the field?

​

• What has been abandoned?

​

• What external factors influenced or affected your plan?

🡪 These questions are meant to be prompts and give direction – you do not have to answer each question explicitly

TFCA Reflection

As you review your original TFCA output and the goals you developed, please consider the following questions as guidance for your narrative:

​

​

• Where is there still need for effort?

​

​

• Are there emergent (new) needs or issues since you completed the TFCA?

​

🡪 These questions are meant to be prompts and give direction – you do not have to answer each question explicitly

TFCA Reflection

As you review your original TFCA output and the goals you developed, please consider the following questions as guidance for your narrative:

​

• Did your TFCA and IP identify tobacco-related disparities in your communities?

​

• Did your TFCA and IP address tobacco health disparities?

​

• What was done to improve these inequities in partnerships and community engagement capacity building?

​

• Looking through a health equity lens, who is currently at the table? Who is missing, and why?

​

🡪 These questions are meant to be prompts and give direction – you do not have to answer each question explicitly.

TFCA Reflection

​

• What activities were most instrumental in developing infrastructure and building capacity around tobacco policy for your organization? Think about:
• Education around tobacco policy
• Engaging the community
• Cessation and cessation resources
• Partnership for the HKCS
• Internal capacity + knowledge building

​

🡪 These questions are meant to be prompts and give direction – you do not have to answer each question explicitly

The Capacity Building benchmarks were developed to help build and strengthen infrastructure around tobacco policy work. Considering that…

TFCA Reflection

Lastly…

​

​

• Do you have any final thoughts on the programming you put forth, the work that was accomplished, the challenges you experienced, or the direction to pursue next?

​

TFCA Reflection

Think about previous efforts in the context of the current grant cycle:

• Do you have questions about your key population(s), available resources, community-perceived problems?

​

• In the previous grant cycle or year, did you get the results you intended? What critical factors affected your outcomes?

​

• What questions might you have asked that could have improved the effectiveness of your activities?

​

• What key lessons did you learn that you can explore through primary data collection?

Submitting

Make sure you get all the way to the end!

Almost there…

All the way there…

Actual final screen:

Reporting Dates:

• May 21 – Webinar
• May 22 – Notes, templates, slides, FAQ posted to VAP
• June 10 – Grantees receive reporting links via email
• June 16 – CEPEG Office Hours with Shannon
• June 24 – CEPEG Office Hours with Shannon
• June 26 – QPR + End of Grant Report DUE

Questions

Email: EvaluationTA@ucdenver.edu

​

Virtual Access Point: bit.ly/CEPEGhome