The CIPP Evaluation model:
Context
evaluation: the objective of context evaluation is to define the
relevant context, identify the target population and assess its needs, identify
opportunities for addressing the needs, diagnose problems underlying the
needs, and judge whether project goals are sufficiently responsive to the
assessed needs through system analyses, surveys, document reviews, secondary
data analyses, hearings, interviews, diagnostic tests, and the Delphi technique.
Input evaluation: main orientation is to identify
and assess current system capabilities, to search out and critically examine
potentially relevant approaches, and to recommend alternative project
strategies using inventorying and analyzing available human and material
resources, proposed budgets and schedules, and recommended solution strategies
and procedural designs.
Process evaluation: objectives include documenting
the process and providing feedback regarding (a) the extent to which the
planned activities are carried out and (b) whether adjustments or revisions of
the plan are necessary using on-site observation, participant interviews,
rating scales, questionnaires, records analysis, photographic records, case
studies of participants, focus groups, self-reflection sessions with staff
members, and tracking of expenditures.
Product evaluation: the purpose is to measure,
interpret, and judge a project’s outcomes by assessing their merit, worth, significance,
and probity. Stufflebeam suggests that a combination of techniques should be
used to assess a comprehensive set of outcomes.
Kirkpatricks evaluation
model:
The
four steps of evaluation consist of:
- Step
1: Reaction - How well did the learners like the learning
process?
- Step 2: Learning -
What did they learn? (the extent to which the learners gain knowledge and
skills)
- Step 3: Behavior -
(What changes in job performance resulted from the learning process?
(capability to perform the newly learned skills while on the job)
- Step 4: Results -
What are the tangible results of the learning process in terms of reduced
cost, improved quality, increased production, efficiency, etc.?
Brinkerhoff’s
Success Case Method:
Determines how
well organizational initiative is working by comparing successful cases to
unsuccessful cases. First, the programs the stakeholders must identify the
program to be evaluated. The
organizations goals and how they are connected to the organization as a hole
are identified. This determines what will be considered as a success in this
organization. Next, participants are interviewed to identify best and worst
cases which can be supplemented with performance records or any other
information that may help locate success cases. This step is followed by an
in-depth interview with success cases to gain detailed information necessary
for documentation. Interviews with unsuccessful cases are also done to help
identify barriers and suggestions of how to improve the program.
This evaluation
model can be used to evaluate my instruction incorporating the use of
technology and social networking in my science classes. With the push of
technology integration in schools, I would like to compare the results from
students who were successful on standardized testing compared to those who were
not successful. Those students who
actively participate in discussions using class social media page both in
responding to questions posed by the teacher and other students seemed to grasp
more abstract concepts than those who were not able to hold meaningful conversations.
Many students were able to find videos that explained difficult or hard to
understand concepts that they could share with their classmates using the class
webpage and email. I would also like to see how parent involvement played a
role in the success of students.
Rossi’s five
domain evaluation model:
This program
attempts to identify an evaluation model that is tailored to fit local needs,
resources, and type of program. First it identifies is there a need for this
type of program? Second is the program developed with the idea that it should
work if carried out as planned? Third, was the program implemented properly?
Fourth, did the program have an impact on its intended target? And lastly, is
the program cost effective?
I would use
this in schools who are looking at moving towards digital editions of textbooks
and supplemental resources for their districts. We all have experienced the
budget cuts and are now faced with the problem of finding print textbooks that
are currently aligned with objectives and standards at our perspective grade
levels. There is a great need for materials that support the content that
should be taught at each grade level to pass standardized testing and
assessments. The digital programs are usually updated regularly to meet the
needs of the consumers without the need to purchase new books each year so as
the standards change, the e-textbooks should be up to date. Given the teacher
resources to support student learning, digital textbooks or supplemental
resources should be able to fill in the gaps where current textbooks and print
resources are lacking. Of course our intended targets would be our students
that we are teaching in our classrooms. The major judgment for many
administrators would be if the products are cost effective. The costs of
printed books now exceeds the initial cost of digital resources, which supports
the cost effectiveness of this type of resource.
3. At the
district I teach at I have been assigned the duty of developing a series of
professional development sessions focusing on technology in the classroom. Our
district has purchased iPads for the teachers and a set of 12 tablets for each
classroom for this implementation but other resources are scarce making this
task a little difficult. Currently I have asked for ideas from other teachers
on technology resources or programs that they have seen or heard of that I can
test or research to see if it would be a possibility for us. I have also asked
for a list of concerns or needs from my team members for their classes that
must be included in this training. I plan on trying to first motivate my team
to “buy” into the idea of using technology in their classrooms to benefit the
students. By introducing simple to implement tools like email and blogs first,
teachers will begin to feel more comfortable using technology daily. I will
create dates that we will slowly add a new technology into the classroom using
the tools we have already without having to purchase any additional materials. I
will set aside individual time to meet with each teacher to make sure they are
comfortable with the new technology before they are expected to introduce it to
their students. Daily communication and feedback will also be a requirement for
determining how both the students and the teachers are accepting the new
programs. By carefully planning and communicating the needs of all my team
members, I will be better able to find materials that we can use in our classes
using the materials we currently have to minimize costs and necessary materials
when introducing technology into our current curriculum.