In the Intel Teach to the Future report, though not labeled similarly to the book chart, each stated section exists in this report including Summary, Purposes, Background information, Description, Results, Discussion, and Conclusion. The report- specific headers provide the reader with a logical flow of information closely connected to the stated sections above. The report is spot on with the evidence provided, and uses this evidence to make informed recommendations related to the program moving forward. One suggestion found in the recommendation/conclusion section is to further examine the program beyond the initial evaluation. The evaluators indicate that more data needs to be established related to the "students' experiences". This observation shows that even though all the necessary components are present in completed evaluation, there may not be a concrete conclusion, something that I readily aware of in my evaluation.
The evaluation methodology used in this report is goal-based using both quantitative and qualitative methods. The rationale given for using this methodology by the evaluator is "to compare the responses of relatively larger groups of program participants to specific survey questions with more detailed and in-depth information collected from smaller groups of program participants through site visits and interviews and to analyze each of these data sources in relation to one another" (Culp, Keisch, Light, Martin &, Nudell, 2003). I found this method to be informative, appropriate, and sound.
Upon reviewing this report, there appears to be a logical flow, following consistently with formatting guidelines provided in the The ABCs of Evaluation textbook. The writing quality is professional and consistent with other evaluation reports and examples provided in the textbook. The writing maintains a consistent academic tone and utilizes properly formatted tables effectively to display survey result data. Tables with completed data are found in the end section "Appendix A: Frequencies from Intel Teach to the Future Preservice Survey". Though not all reports consist of similar headings, this report does follow closely with the Summary, Purposes, Background, Description, Results, Discussion, and Conclusion format presented in The ABCs of Evaluation text. It is worth noting that the summary requirement is recommended as the last section to be completed, and after reading this report, this is the conclusion I came to based on the information and data provided within the report. Formatting is also something that one may wrestle with when designing an evaluation report.
This report was extensive and an overwhelmingly informative induction into a professional evaluation. The evaluators, three of which holding doctorate degrees, presented the information in a way that was easy to analyze evidence and interpret the scope of the evaluation. For example, one must look at the value and emphasis provided in the survey data. The data provided explains specific details, so the reader of the report is informed and not left with questions. The construction of effective explanations to survey findings is something to focus on in my own evaluation report and this report example will serve as a good reference in doing so.
Suggestions for Improvement
Online surveys can be a tricky business and this holds true in this report. Of the 545 faculty members attached to this evaluation report, only 27% completed the initial surveys. Even though reminders were sent out by the evaluators to complete the survey, this appears to be a low number. As discussed in EdTech 504, surveys can present a variety of issues related to stakeholder participation. This statement is evident in this evaluation report as 73% did not complete the initial survey. This is not a suggestion for improvement, but something to consider moving forward with an evaluation. Was there another strategy that could have been explored to capture more results from stakeholders? One reminder email was given and in my experience with online surveys, often times several reminders are delivered to stakeholders. I feel like I may be reaching for a suggestion here.