Program Evaluation:
A systematic method for collecting, analyzing, and using information to answer questions about projects, policies and programs, particularly about their effectiveness and efficiency.
Formative Evaluation:
Any evaluation that takes place before or during a programs implementation with the aim of improving the program’s design and performance.
Summative Evaluation:
Any evaluation that takes place after a program’s implementation with the focus on the outcome of a program.
Do you need to record attendance/punctuation/financial information or anything else that may be used in your program evaluation?
Attendance sheet, #’s of participants or time each person participated in an activity, budget, session feedback/ evaluation.
Do you need to record any information at the beginning of the program that you may want to use later on within your program?
Participation contract, reflection journal to record answers to questions prior to or during participation, any pre/post test measure.
Benefits of documentation:
- If you have many participants, you will not always remember individual details
- Risk management and safety: on an outing, an attendance sheet is a good visual for a reference check
- Supports performance measurement of program if built in
- Accountability: records information for program evaluation
Benefits of evaluation:
- Improve programs, events, and services
- Seek out and eliminate detrimental elements
- Risk management and safety
- Determine if programs meets the goals and objectives
- Improve decision making
- Enhances professional practice
- Comply with internal and external standards
- Increase participant satisfaction
- Explain and learn from success and failure
Strengths are?
Factors that have encouraged exceptional program performance (Ex. Use of technology and good equipment, well written SPP, Highly trained staff, Quality and standardization in services)
Weaknesses are?
Factors that affect program quality or increase program costs (Ex. Outdated eqip. and facilities, lack of financial resources, poor use of participation information, insufficient volunteer training)
Opportunities are?
New ideas and initiatives that are “smart business sense” (Ex. Collaborations with different sources, development of new programs, creative ways to use supplies/ eqip. to reduce costs)
Threats are?
Factors that can harm the performance of programs (Ex. participant boredom, budget deficits, increased pressure for programming costs)
Participant Feedback
Formative and Summative are important (Ex. Observation, verbal questioning, comment cards, attendance, goal progress)
Importance of documentation and evaluation?
- Best practice standards
- Timeline
- Report
- Ethics
- Interprofessional Team
Assessment, Intervention Plan, Program Plan
“Where are you now?”, “How will you get there?”, “What are we going to do?”
Rational for collaborative planning
- Empowers and inspires the client
- Focus on the client as an individual
- Provide systematic approach to helping
- Support an interprofessional approach to care
- Goals and objective aligned with each other
- Increase success of intervention
- Meet standards of practice
What is an intervention plan?
The roadmap that a client will follow on his/her journey through treatment
- Focuses on behaviour, skills, attitudes and knowledge
- Designed in advance for effective delivery
- Produce targeted and desired client outcomes
- Produce evaluation data
- Ultimate outcome: Behavioural change
Content of the intervention plan:
- Background/demographic data
- Precautions and contradictions
- Referral
- Assessment results
- Goals
- Objectives
- Action plan/ strategies for participant involvement
- Frequency and duration of participation
- Interaction styles and approaches
- Staff and participant responsibilities
- Evaluation plan
- Signatures and dates
Background/demographic data
- Brief summary (ex. name, gender, age, diagnosis, occupation)
Precautions and contradictions
- Special considerations
- Important points related to health (Ex. medications, secondary conditions, allergies, “triggers”)
Referral
- From whom, when, and why the referral to T.R. services came
Assessment results
- Brief summary
- Include strengths as well as needs/ concerns/ areas for development
- Rest contained in file
Goals
- Participant centered
- Describe outcomes in general terms
- Number and nature will vary (short term/long term)
- Goals set a foundation for our objectives
- Tells us what our clients want to learn, develop, overcome
Objectives
- Derived from goals
- In TR, often called “behavioural objectives”
- More specific, measurable description of participant outcomes will be
- Should be SMART
- Contain 3 elements (Condition, behaviour, and criteria)
Overt vs. Covert
Overt: Performance that can be observed directly (concise and specific)
Covert: Performance that can not be observed directly (open to interpretation)
