Karrie Cox

EdTech 505, Week 4

Assignment 4

Chapter 9 – Writing the Evaluation Report (Boulmetis & Dutwin text)

A. Do the “Questions and Exercise” on pp. 202-3. Make sure your response is in 1-2-3 order.

  1. Do I need an evaluation report?

Boulmetis & Dutwin (p.197) note that there is no point in designing and conducting an evaluation if you don’t plan to share your information to the people that need it.    Your program could suffer from not reporting an evaluation, even lead to its demise.   For example, an end of the year report is an evaluation that would include data that could be compared to previous years, thus creating a foundation to help make future decisions.

Ruth has a very important concern about getting an evaluation report completed.  She knows that one of the requirements in receiving the grant from the Beed Foundation was to provide an evaluation of the program, how funding was used, and the benefits derived from the program.  

  1. For whom do I write the evaluation report?

The major stakeholder is “The Beed Foundation”.  Other stakeholders who would be interested in the evaluation would be Grandview Retirement and Nursing Facility administration as the findings would help them make decision for their own operating program.

  1. What are the key components of an evaluation report?

Key components of an evaluation report are:

  1. Cover page:  This includes the topic of the evaluation report, who prepared it, and to whom it will be submitted to.
  2. Executive Summary: This is finalized at the end of the project.  This part provides a brief picture of the program and summarized the evaluation into smaller chunks of information designed for a quick interpretation of the evaluation results and conclusions.  The evaluation questions and data collection should be included here as well.
  3. Methodology:  Purpose of the evaluation covers who, what and why. This would include the history of the program (unless this is a new program), the goals, objectives, strategies and target population.  Methodology: covers the methods in detail enough that others may be able to reproduce your approach.
  1. Background information that describes how the program started and what it is to accomplish.
  1. Description of the evaluation study covers the methodology, evaluation design, instrumentation, analyses and results.
  1. Evaluation design: would include information on when data collection will take place (weekly, monthly, quarterly, etc.) and where the data is being collected from.
  2. Instrumentation: What type of data sources are being used such as records, pre-test, post-test, questionnaires, interviews, etc.
  3. Analyses: this would cover how data was collected and who was responsible.
  1. Results: Covers items such as limitations of evaluation and/or problems. Other things should include positive items as well.  This section covers interpretation of the evaluation, its findings as far as meeting the projects objectives
  2. Objectives: Covers each objective in the evaluation process in more detail cover how they have been met.
  3. Recommendations: This part provides is where the evaluator draws specific conclusions about success or failure of the program cover each objective.  The findings reflect insight for recommendations of program suggested improvements covering a wide variety to items that were involved in the program.
  4. Appendixes:  This section provides an area for forms, data, and other items relevant to the program.

C:  Discuss Appendices B and C in general and/or specific terms. (No word min./max.)

· Appendix B – Sample Evaluation Report

After reading the Sample evaluation report, “Zoo in the Community”, the contents appear to have been written as the final evaluation for the funding agencies.  The Zoo can also benefit from this information for public relations, compare to other ongoing projects.  

What I found interesting are the recommendation suggested by the evaluator.  This appears to provide information for improvements in the program including other avenues to explore with this project in other parts of the zoo.

The report lacked costs associated with the project in the form of a budget.  Isn’t this something that would be crucial especially if there will be the opportunity for further funding from the same grant funding company.

· Appendix C – Sample Evaluation Contract

The sample evaluation contract in Appendix C of the Boulmetis & Dutwin text appears to address all areas appropriately, with actives and data sources and collection areas.

General tasks provided in the beginning are descriptive.  The tasks go into further detail in the evaluation plan.

Evaluation question provides information on how the question will be addressed and what information will be extracted.

Projected budget provides the costs associated with the project, however I wonder if there shouldn’t be more detail on the “Fringe” cost and what it covers.  Of course I don’t know if there are any appendices’ that are associated with this.

My concerns are about the list of what is to be done.  The tasks are listed but those are very general and may mean one thing to one person and interpreted a different way by another.  To fix this, a bit more detail would be beneficial.  The costs associated with this project mentioned a trainers and then interviews however the projected budget didn’t really specify this area in the budget.  Is this fall under the research associates fee or is that what the “Fringe” line items are?  Last, the project budget states “year one”, there is no time frame noted for the items mention of pre, interim and post data collection dates.

Being a beginner in creating an evaluation project of my own, the information illustrated in the sample contract would help.  Though, I think it would be better to provide more details in the contract, those issues that I have mentioned above.

4. Bonus activities (Optional –You do not have to do these but if you do them correctly, you earn one point for each successfully done activity.)

a. Locate a website that would supplement the content in either Appendix B or Appendix C. Include the full URL and describe it in a minimum 50 words.

Western Michigan University Evaluation Center. (n.d.). Evaluation Checklists. Retrieved September 21, 2013, from http://www.wmich.edu/evalctr/checklists/ 

University of Western Michigan, “The Evaluation Center” web site provides plenty of helpful information for conducting evaluations.  There are five icons listed on the site covering to help anyone find information on how to conduct an evaluation.  Their check lists supplement what is covered in Appendix C.    An evaluation check list by Daniel Stufflebeam provides the seven main areas of an evaluation.  Providing a check list of items in each section with informational questions of what should be covered in that particular area.

b. Create a higher order thinking skills (HOTS) level assignment that could be used with Chapter 9, Appendix B, Appendix C, or any combination. You do not have to actually do it.