Discussion 3

The CIPP Evaluation model:

Context evaluation: the objective of context evaluation is to define the relevant context, identify the target population and assess its needs, identify oppor­tunities for addressing the needs, diagnose problems underlying the needs, and judge whether project goals are sufficiently respon­sive to the assessed needs through system analyses, surveys, document reviews, secondary data analyses, hearings, interviews, diagnostic tests, and the Delphi technique.

Input evaluation: main orienta­tion is to identify and assess cur­rent system capabilities, to search out and critically examine poten­tially relevant approaches, and to recommend alternative project strategies using inventorying and analyzing available human and material resources, proposed budgets and schedules, and recommended solution strategies and procedural designs.

Process evaluation: objectives include documenting the process and providing feedback regarding (a) the extent to which the planned activities are carried out and (b) whether adjustments or revisions of the plan are necessary using on-site observation, participant interviews, rating scales, questionnaires, records analysis, photographic records, case studies of partici­pants, focus groups, self-reflection sessions with staff members, and tracking of expenditures.

Product evaluation: the purpose is to measure, interpret, and judge a project’s outcomes by assessing their merit, worth, sig­nificance, and probity. Stufflebeam suggests that a combina­tion of techniques should be used to assess a comprehensive set of outcomes.

Kirkpatricks evaluation model:

The four steps of evaluation consist of:

• Step 1: Reaction - How well did the learners like the learning process?
• Step 2: Learning - What did they learn? (the extent to which the learners gain knowledge and skills)
• Step 3: Behavior - (What changes in job performance resulted from the learning process? (capability to perform the newly learned skills while on the job)
• Step 4: Results - What are the tangible results of the learning process in terms of reduced cost, improved quality, increased production, efficiency, etc.?

Brinkerhoff’s Success Case Method:

Determines how well organizational initiative is working by comparing successful cases to unsuccessful cases. First, the programs the stakeholders must identify the program to be evaluated.  The organizations goals and how they are connected to the organization as a hole are identified. This determines what will be considered as a success in this organization. Next, participants are interviewed to identify best and worst cases which can be supplemented with performance records or any other information that may help locate success cases. This step is followed by an in-depth interview with success cases to gain detailed information necessary for documentation. Interviews with unsuccessful cases are also done to help identify barriers and suggestions of how to improve the program.

This evaluation model can be used to evaluate my instruction incorporating the use of technology and social networking in my science classes. With the push of technology integration in schools, I would like to compare the results from students who were successful on standardized testing compared to those who were not successful.  Those students who actively participate in discussions using class social media page both in responding to questions posed by the teacher and other students seemed to grasp more abstract concepts than those who were not able to hold meaningful conversations. Many students were able to find videos that explained difficult or hard to understand concepts that they could share with their classmates using the class webpage and email. I would also like to see how parent involvement played a role in the success of students.

Rossi’s five domain evaluation model:

This program attempts to identify an evaluation model that is tailored to fit local needs, resources, and type of program. First it identifies is there a need for this type of program? Second is the program developed with the idea that it should work if carried out as planned? Third, was the program implemented properly? Fourth, did the program have an impact on its intended target? And lastly, is the program cost effective?

I would use this in schools who are looking at moving towards digital editions of textbooks and supplemental resources for their districts. We all have experienced the budget cuts and are now faced with the problem of finding print textbooks that are currently aligned with objectives and standards at our perspective grade levels. There is a great need for materials that support the content that should be taught at each grade level to pass standardized testing and assessments. The digital programs are usually updated regularly to meet the needs of the consumers without the need to purchase new books each year so as the standards change, the e-textbooks should be up to date. Given the teacher resources to support student learning, digital textbooks or supplemental resources should be able to fill in the gaps where current textbooks and print resources are lacking. Of course our intended targets would be our students that we are teaching in our classrooms. The major judgment for many administrators would be if the products are cost effective. The costs of printed books now exceeds the initial cost of digital resources, which supports the cost effectiveness of this type of resource.

3. At the district I teach at I have been assigned the duty of developing a series of professional development sessions focusing on technology in the classroom. Our district has purchased iPads for the teachers and a set of 12 tablets for each classroom for this implementation but other resources are scarce making this task a little difficult. Currently I have asked for ideas from other teachers on technology resources or programs that they have seen or heard of that I can test or research to see if it would be a possibility for us. I have also asked for a list of concerns or needs from my team members for their classes that must be included in this training. I plan on trying to first motivate my team to “buy” into the idea of using technology in their classrooms to benefit the students. By introducing simple to implement tools like email and blogs first, teachers will begin to feel more comfortable using technology daily. I will create dates that we will slowly add a new technology into the classroom using the tools we have already without having to purchase any additional materials. I will set aside individual time to meet with each teacher to make sure they are comfortable with the new technology before they are expected to introduce it to their students. Daily communication and feedback will also be a requirement for determining how both the students and the teachers are accepting the new programs. By carefully planning and communicating the needs of all my team members, I will be better able to find materials that we can use in our classes using the materials we currently have to minimize costs and necessary materials when introducing technology into our current curriculum.