2.jpg){kind=logo}
About 6,100 seniors were supported in community living by Seniors Activity Centres in FY2010.
Home >> VWO Corner >> VWO Service Standards >> Programme Evaluation System (PES)
Understanding Enhanced Programme Evaluation System (EPES)
Enhanced Programme Evaluation System
The NCSS Enhanced Programme Evaluation System (EPES) incorporates an Outcome Management (OM) approach to the Programme Evaluation System (PES). NCSS had developed EPES together with the VWOs to help them run efficient and effective services. All programmes funded by Community Chest and some programmes funded by ministries have adopted EPES.
Programme evaluation is a process that entails the comparison of measurable programme outputs and outcomes with defined standards of performance. It is thus the assessment of the extent to which the programme’s goals and objectives have been met.
The OM approach enhances programme evaluation by adopting a client-centric approach, assessing programmes based on clients’ needs and its success in helping clients to achieve a positive change in their behavior, knowledge, skills, attitude, condition or status.
VWOs can use the EPES information to improve services and its mode of delivery by assessing if the programme’s objectives and targets have been met. If targets have been met, VWOs can assess if targets can be raised to meet a higher level of service delivery. If targets have not been met, VWOs can seek the reasons for this and take steps to rectify the situation. The cycle of programme evaluation can then be repeated to assess if the programme’s objectives and targets have been met.
Enhanced Programme Evaluation System Framework
An example of a programme that had adopted the EPES framework can be found below.
In the example, the programme provides therapy rehabilitation services to the clients. The example shows some typical data that will be collected by the programme to help in understanding the efforts of the programme, and the needs of the clients and the client outcomes to be achieved.
Assessing Programme's Achievement of Goals |
Assessing Clients' Achievement of Outcome |
| Output data E.g. Total no. of cases served |
Client Outcomes and Milestones data E.g. Client Outcome: Out of 50 clients receiving Physiotherapy programme, 25 clients will achieve the stated goals with or without adaptive equipment and sustain for at least 6 months. Milestone 1: 50 clients will receive initial assessment in the area of muscle and joint range, trunk control, and trunk mobility. Milestone 2: 40 clients will demonstrate achievement in 1 goal / skill Milestone 3: 35 clients will demonstrate achievement in 2 goals / skills Milestone 4: 30 clients will demonstrate achievement in 3 goals / skills Milestone 5: 25 clients will sustain the skills for 6 months |
| Output data: | Typically quantity data. E.g. No. of clients served, no. of counselling sessions conducted
|
| Client outcome: | Targeted achievement by the clients at the end of the programme, related to the clients’ change in behavior, knowledge, skills, condition or status. |
| Milestones: | Progressive achievements by the clients on the way to achieving the final outcome |
The milestones tracked in the EPES framework allow VWOs to evaluate and articulate the achievement of the programme better. For example, 20 clients from the therapy rehabilitation programme with cerebral palsy are able to sit up without adaptive equipment. If the number achieved is lower than expected, the VWO can review their performance to evaluate reasons for failure and improve on them. If the number achieved is higher than expected and the VWO had evaluated that their effort paid off better than expected, they could continue the good practices.
Implementation of Enhanced Programme Evaluation System
To implement the Enhanced Programme Evaluation System is to plan for a programme with the end in mind. Planners of programmes should have a clear understanding of the client, community, and the specific changes that are sought for their clients. This will enable them to identify the programme’s goals and objectives in the form of critical steps or milestones that clients need to take in order to achieve the specific changes required.
The NCSS Enhanced Programme Evaluation System is a framework that captures both the work done by the programme and also the outcome of the client during and after participation in the programme.
Importance of Enhanced Programme Evaluation
|
Programme evaluation offers service providers a way of regularly reviewing programme objectives to ensure relevance. |
|---|---|
|
It allows a systematic way of identifying critical outputs and outcomes of a service, thus defining what the service is trying to achieve. |
|
With the review of objectives, it allows for greater focus and direction in how resources are utilised to achieve the stated objectives. |
|
By defining the level of service, acceptable standards for programmes are set and thus targets to aim for are determined. With this, the accountability for public funds is enhanced and donors can better understand the quality of services provided and the impact of a programme on the clients. |
Outcome Funding Agreement
Increasingly, funders want to know the benefit that their supported programmes have brought about for the clients. In outcome funding, funders explicitly support the outcomes of a funded programme rather than just the activities.
NCSS has implemented outcome funding for VWO programmes supported by Community Chest. With effect from FY2010, all Community Chest funded programmes have adopted the Outcome Funding Agreements.
Milestones in the Development of Enhanced Programme Evaluation System
2001 |
Implemented Programme Evaluation System (PES) to capture critical programme outputs and outcomes |
|---|---|
2004 |
Introduction of Outcome Management (OM) concept to enhance PES (EPES) |
2005 |
A series of OM training sessions were conducted for different levels of VWO staff and board members |
2006 |
Implemented OM concept to incorporate client-centric outcomes into EPES with selected VWO programmes |
2007 |
All ComChest-funded programmes adopted the EPES to monitor and evaluate achievements |
2010 |
All ComChest-funded programmes adopted Outcome Funding Agreements |
