Understanding the Programme Evaluation System (PES) |
 |
What is programme evaluation? |
 |
| The NCSS Programme Evaluation System (PES) is modelled after the United Way Outcome Measurement framework. Programme evaluation is a process that entails the comparison of measurable programme outputs and outcomes with defined standards of performance. It is thus the assessment of the extent to which the programme's goals and objectives have been met. |
 |
| The NCSS Programme Evaluation System currently measures the critical output and outcome indicators that determine the basic level of service delivery for a particular programme. |
 |
Why is programme evaluation important? |
 |
PES |
 |
- allows NCSS to further professionalise the social service sector.
- offers service providers a way of regularly reviewing programme objectives to ensure relevancy. It also allows a systematic way of identifying critical outputs and outcomes of a service, thus defining what the service is trying to achieve. With the review of objectives, it allows for greater focus and direction in how resources are utilised to achieve the stated objectives. By defining the level of service, acceptable standards for programmes are set and thus targets to aim for are determined. With this, the accountability for public funds is enhanced.
- verifies programme effectiveness and benefits to clients once fully established. It will lead to improvement in services as resources are better directed to achieve defined level of service. Clarity on the expectations of an organisation's programmes and how it achieve these objectives, will build organisational confidence and capability. With the articulation of how these programmes objectives are achieved and how it was measured, there will be greater transparency and accountability of resources to clients, donors, funders and volunteers.
|
 |
 |
Who has implemented the PES? |
 |
| PES has achieved the endorsement of the following government ministries the Ministries of Community Development, Youth and Sports (MCYS), Education (MOE), Health (MOH) and Home Affairs (MHA). |
 |
| Fiscal year 2001/2002 was the first year of implementation of PES. As of April 2003, 100% of NCSS funded programmes had implemented PES. |
 |
| With effect from fiscal year 2003/2004, PES was extended to the non-NCSS funded programmes, as enhancing standards affect all in the social service sector. Most of the non-NCSS funded programmes that have implemented the PES receive funding from MCDS and have alternative sources of funding. These include client fees, donations from the general public and funds raised through the organisation's fund-raising efforts. |
 |
| List of programmes that have implemented PES (as at April 2007) (pdf format) |
 |
|
 |
 |
Enhancement of the PES |
 |
| In 2005, NCSS introduced the concept of Outcome Management to enhance the PES framework. Outcome Management allows social service organisations to track their achievement of client milestones and outcomes, thus breaking down the process steps in the achievement of programme outcomes for further analysis and use for the improvement of services. |
 |
| With effect from FY2007, programmes funded by NCSS and its fund-raising arm, the Community Chest, adopted Outcome Management for the tracking of outcomes. |
 |
 |
FREQUENTLY ASKED QUESTIONS |
 |
| FAQs for VWO |
 |
 |
| 1. |
What is PES? |
| A. |
PES is a tool to measure if outputs and outcomes of a programme have been met, and the extent to which these have been met. |
 |
| 2. |
Why is PES important? |
| A. |
PES helps a service provider monitor the performance level of its programme, and sets in place a guide to ensure that the programme stays focused on what it was set out to achieve. PES data can also be used to inform donors and members of the public on the achivements of the programme. |
 |
| 3. |
What is the PES unable to do? |
| A. |
While PES offers the user an observation of what the performance level of a programme is, PES is not an in-depth research tool that offers the reasons for the performance level. |
 |
| 4. |
Why does NCSS not fund all the programmes that have implemented the PES? |
| A. |
Most of the non-funded programmes that have implemented the PES receive funding from MCYS and have alternative sources of funding. These include client fees, donations from the general public and funds raised through the organisation's fund-raising efforts. Although NCSS does not fund all the programmes that have implemented the PES, the system is extended to these programmes as enhancing standards affect all service providers in the social service sector. |
|
 |
|
 |
 |
Frequently Asked Questions - VWOs |
 |
 |
| 1. |
How does PES help an agency? |
| A. |
PES ensures that information on the performance level of a programme is available at any given point in time. With such information available, decision-making is facilitated. The PES data advises an agency on what is achievable, so that realistic targets can be set. The PES information also informs the agency's management on the programme's strengths and areas for improvement. PES reports can keep agency staff informed of their efforts in achieving programme outcomes. Sharing of such information can motivate staff to achieve even better outcomes. |
 |
| 2. |
What can agencies do to make PES work for them? |
| A. |
Based on the observations offered by PES, qualitative data can be collected to further analyse what the reasons are behind the PES data trends. This can then advise the agency's management of areas they might wish to further develop. |
 |
| 3. |
How can agencies use PES information for donors and members of the public? |
| A. |
Donors and members of the public are often curious as to what social service programmes can achieve. It is not always easy to explain the outcomes of such programmes. The PES information offers a way of showcasing what the outcomes of a programme are and what kind of activities are needed to achieve the goals. It can also advise donors and members of the public the performance level of a programme. |
 |
| 4. |
Will the workload of my agency increase? |
| A. |
In the initial phase, the agency will need to spend some time building on current systems to gather the PES data. After this initial period however, there should not be too much extra workload. PES focuses on gathering only critical indicators that are mutually agreed upon by NCSS and the service operator. In the development phase, much emphasis is given on choosing indicators that are simple and not too cumbersome for agencies to collect. |
 |
| 5. |
What will be done with the submissions? |
| A. |
NCSS will analyse the submissions and forward reports to funding partners. |
 |
| 6. |
Will the results of the submissions affect funding from NCSS? |
| A. |
In the initial stages of development, the results will not be linked directly to funding decisions. Over time, once the system has stabilised, the results will guide funding decisions. If the results of the analysis indicate problems of service delivery, agencies are expected to take corrective actions as necessary to strengthen the programmes. If programmes consistently show poor results, an in-depth review of the programmes may be undertaken. |
|
 |
|
| |