Evaluation Database.xlsx

	A	B	C	E	F	G	H
1
2
3
4
5
6
7
8
9	Initiative Stage	Evaluation Type	Group	Potential Evaluation Questions	What to Record, Track and Report	Suggested Data Collection Tool	When to Collect Data
10
11	1) Not Started	Needs Assessment	Community	Who needs care in our community and what are those needs? What are some of the gaps that exist around these needs?	List of needs and gaps identified by community members and appropriate stakeholders	Environmental Scan (external documents, literature, websites), Survey	At the beginning of the initiative and every 3-5 years
12			Organization	What are our goals for this initiative and how can we achieve them?	Perspectives from management and/or community members	Interviews, Focus Groups	At the beginning of the initiative and ongoing
13			Target Audience	In what ways would we like people to benefit from our initiative? How will we know if we've succeeded?	List of short-, medium- and long-term outcomes (e.g., logic model), perspectives and rationale for anticipated benefits	Interviews, Focus Groups	At the beginning of the initiative
14			Target Audience/Community	What is the geographic reach of our initiative?	Formal or informal operational plan (geographic reach - e.g., city, county, provincial, national)	Environmental Scan (external documents, literature, websites), Survey	At the beginning of the initiative and ongoing
15			Organization	What do we need in terms of human and financial resources? If we need more, how will we get them?	Formal or informal operational plan (HR and financial needs)	Environmental Scan (external documents, literature, websites), Interviews	At the beginning of the initiative
16	2) Public Awareness		Community/Partners	How can we get the word out about our initiative? Who might benefit from hearing about our initiative?	Formal or informal marketing plan (ideally informed by community member needs and preferences)	Environmental Scan (external documents, literature, websites), Survey	At the beginning of the initiative and ongoing
17	3) Engaging Partners		Community/Partners	Are there specific groups that could benefit from our initiative (e.g., Indigenous peoples, urban/rural populations)? How will we go about engaging/ collaborating with them?	Number and demographic information of people that will be served by our initiative (e.g., target age, education level, cultural background)	Environmental Scan (external documents, literature, websites), Population Stats published by your province, city or county	At the beginning of the initiative and every 3-5 years
18	4) Co-Planning		Community	Are there other organizations doing similar things? What would be different about our initiative?	List of other organizations and their services, list and describe the services to be offered through our initiative	Environmental Scan (external documents, literature, websites)	At the beginning of the initiative and every 3-5 years
19	4) Co-Planning		Target Audience	Are there other organizations, stakeholders or communities that we would benefit from engaging/consulting/partnering with?	List of organizations, stakeholders or communities that can assist us in achieving our goals, Partnership Agreements	Environmental Scan (external documents, literature, websites), Survey	At the beginning of the initiative and ongoing
20
21	5) Initial Implementation	Implementation Evaluation	Organization	Were all initiative activities delivered as planned?	List of completed activities against planned	Internal documents	Within the first 6-12 months and every 3-5 years
22			Community/Partners	Who is involved in our initiative?	Number of participants, volunteers, staff, consultants, researchers, partners, sponsors, etc.	Internal documents	Within the first 6-12 months
23			Organization	Are all roles and responsibilities for our initiative clear and well-understood?	Perspectives from staff/volunteers, management and stakeholders	Interviews, Survey	Within the first 6-12 months
24			Organization	Did our staff/volunteers receive the training they need to implement the initiative?	List of training received against training needs, satisfaction on training quality by staff/volunteers (e.g., increased knowledge, skills, confidence)	Internal documents, Survey	Within the first 6-12 months and every 3-5 years
25			Organization	What products have we developed as part of our initiative?	List of products (e.g., manuals, toolkits, guides) developed or updated	Internal documents	Within the first 6-12 months and every 3-5 years
26	6) Early Implementation		Organization	Is there anything about the design or delivery of this initiative that worked particularly well or could be improved?	Perspectives on design and delivery of the initiative by staff/volunteers, management and community members	Interviews, Survey, Focus Group	Within the first 6-12 months
27			Target Population	How satisfied is our target population with our activities? Is there anything we can do to improve the quality or usefulness of the activities?	Target population satisfaction with activities and suggestions for improvement	Survey	Within the first 6-12 months and every 3-5 years
28			Organization	Is our initiative on track to meet its goal(s) and outcomes? If not, what changes can we make to increase our chances of success?	Outputs produced vs. planned, early indicators of success (e.g., number of people reached; reported increases in awareness, knowledge, skills, confidence, and/or access; changes in attitude or behaviour), perceptions on success to date and opportunities for improvement	Internal documents, Interviews, Survey	Within the first 6-12 months and every 3-5 years
29			Organization	Are there resource adjustments (i.e., human or financial) needed at this time?	Update to operational plan (HR and financial needs)	Internal documents, Interviews	Within the first 6-12 months and every 3-5 years
30			Community	Are there other social, economic, environmental or cultural considerations that would increase our chances of success? Are there other populations that might benefit from our initiative?	Opportunities to increase reach or success within a larger community context	Environmental Scan (external documents, literature, websites), Survey	Within the first 6-12 months and every 3-5 years
31			Organization	Are the roles and responsibilities of our key partnerships still clear and appropriate for this initiative? Could they be improved? Are there other partnerships that we should be exploring at this time?	Perspectives from partners on the clarity of roles, responsibilities, and opportunities for improvement, perspective from management and partners on new partnership opportunities	Interviews, Survey, Focus Group	Within the first 6-12 months and every 3-5 years
32			Organization	What lessons have we learned to date and how can we apply them to improve our initiative going forward?	Perspectives on lessons learned by staff/volunteers and management	Interviews, Survey, Focus Group	Within the first 6-12 months and every 3-5 years
33
34	7) Mid-Implementation	Outcome Evaluation		What are the key outcomes your initiative is trying to achieve?	List of outcomes to be achieved	Internal documents	At the beginning of the initiative and every 3-5 years
35			Organization	To what extent has our initiative achieved its short-term outcomes?	Progress against identified outcomes (e.g., increased access to products and services; participation rates; satisfaction)	Interviews, Survey, Focus Group	Within 12-18 months and every 3-5 years
36			Organization	To what extent has our initiative achieved its medium-term outcomes?	Progress against identified outcomes (e.g., changes in skills and behaviour; satisfaction; feeling well-supported, well-equipped)	Internal documents, Survey	Within 12-18 months and every 3-5 years
37			Organization	Were there any outcomes that were unexpected (positive or negative) as a result of our initiative?	Description of unexpected outcomes	Interviews, Survey, Focus Group	Within 12-18 months and every 3-5 years
38			Organization	To what extent did we complete the initiative on budget?	Formal or informal operational plan (budget - planned vs. actual)	Internal documents	Within 12-18 months and every 3-5 years
39			Organization/Partners	(If looking to expand) In what ways could we scale up our initiative and what would we have to do to achieve this?	Perspectives on scale up by management and stakeholders, formal or informal dissemination plan	Environmental Scan (external documents, literature, websites), Internal documents, Interviews, Focus Group	Within 12-18 months and every 3-5 years
40			Organization/Partners	(If looking to continue) How sustainable is our initiative and how do we ensure its continued success?	Perspectives on sustainability by management and stakeholders	Interviews, Survey, Focus Group, Internal documents	Within 12-18 months and every 3-5 years
41			Community/Partners	Who will lead this initiative into the future and are there considerations to be made or resources to be developed to facilitate this?	Perspectives on how best to transition the initiative by management, stakeholders and relevant community organizations, formal or informal transition plan	Interviews, Survey, Focus Group, Internal documents	Within 12-18 months and every 3-5 years
42
43	8) Mature Implementation	Impact Evaluation	Community/Partners	What is the impact on the community you are serving?	Increase in community well-being, perspectives of stakeholders and community organizations on the initiative's contribution	Internal documents, Survey, Interviews	Every 3-5 years
44			Organization	To what extent has our initiative achieved its long-term outcomes?	Progress against identified outcomes (e.g., increased feelings of empowerment; community-level benefits)	Internal documents, Survey, Focus Group	Every 3-5 years
45			Target Population	What has been the impact of our initiative on our target population?	Impact of the initiative on participants compared to an alternative initiative or no initiative (i.e., why was it worthwhile?)	Internal documents, Interviews, Survey, Focus Group	Every 3-5 years
46			Organization	What has been the impact of our initiative on staff/volunteers?	Impact of the initiative on staff/volunteers compared to an alternative initiative or no initiative (i.e., why was it worthwhile?)	Internal documents, Interviews, Survey, Focus Group	Every 3-5 years
47			Organization	What has been the impact of our initiative on our organization?	Impact of the initiative on your organization compared to an alternative initiative or no initiative (i.e., why was it worthwhile?)	Internal documents, Interviews, Survey, Focus Group	Every 3-5 years
48			Organization/Partners	What other partnerships could be helpful to the sustainability of our initiative? Could current partnerships be expanded or strengthened?	Perspectives on strengthening or expanding partnerships by management and stakeholders	Survey, Interviews	Ongoing
49			Organization/Partners	Where do we take the initiative from here?	Perspectives on next steps by management, community members and stakeholders	Survey, Interviews	Every 3-5 years
50			Organization/Partners	How do we share the results of our initiative with people who could benefit from them?	Formal or informal dissemination plan	Internal documents, Interviews	Ongoing
51	Version 2023	Compassionate Communities Evaluation Guide - Evaluation Database
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100