Monday 10 February 2014

Assignment 2

Assignment 2

Evaluating a program effectively is difficult. I will endeavour to keep this response concise and coherent.

Approach

I think if I need to evaluate this program I would use primarily the Provus model with some consideration of the Bennett's hierarchy of evidence for extension. Bennett's model is not an evaluation theory but a means of simplifying a program to look at it's logic and how the inputs plan to lead to results. The Provus model would allow for a thoughtful review of the design and implementation using the DIPP process. This would highlight changes to the procedure as the needs and target demographic has been well documented and researched.

Rational

This program is attempting to deal with a complex multifaceted medical issue. While dealing with the complexities of this medical issue this program is also addressing a difficult social issue. This leads to a challenging evaluation.

The provost model focuses on three main areas; a)defining program standards, b) determining discrepancy and c) using info to change/modify. As I read I am not sure the program has specific outcomes. The goal and need is made clear however the information does not address any way of knowing if that is happening. I know this may be intentional as assessment is specifically what I am attempting to discern, but I feel that the program outline has failed to outline any expectations of what success would look like. This first stage is where I found the Provus model difficult apply. The program has taken many steps to improve the different areas of their program but seems to lack a plan for change implementation.

As a bit of an aside, but hopefully relevant, my wife studied program design recently in her work to achieve her own masters and in her health care focus almost all programs are effectiveness based programs. They need to, on a fundamental level,  direct goals to the improvement of the patient. To frame the rest of my thoughts I would evaluate with the end person in mind. The Provus model does not put any pressure on specific people and looks at what is different from what is intended. This model might help in a situation where many people are working together on a sensitive issue.

 If one looks at the 7 levels of the hierarchy you could ascertain some more specific areas to help create clearer program standards and areas for evaluation and discrepancies.

Fist I think the resources (yellow) are a great area of focus. The program uses many people and programs to attract participants. A standard for what success in resources looks like should be clear.

Participation and Activities (green) have been carefully considered and the structure seems to be working so this area many not need much work.

For the greatest change I think the area of reactions and learning needs to be addressed. This is an area where data could be collected to help shape the program in the future. What learning is being done and how does that look compared to the programs goals.

This leads to the focus question of does this program change behaviour. The whole design is to improve health by changing behaviour so I think this would need to be addressed in the evaluation. A lot of work needs to go into how exactly this could be measured but I think that is where the assessment focus needs to end up.

Overall the Provus system would allow a look at accountability and help find areas where what is happening does not match what the program wants to happen. I think that it would provide a solid response that would not offend or ostracize people and help define success in a complex area.

1 comment:

  1. Jon I like that you have introduced a new model to the process and that you are using your peers to guide your decision making process. You choose a model and not only see how it works but also share how you feel it will not work. This is an important negotiation process when it comes to formulating your evaluation plan. What you have written tells me that you have an understanding of what you are doing or plan to do. You keep the needs of the client in mind throughout and make a good connection to the hierarchy.

    Well done!
    Jay

    ReplyDelete