Evaluation Checklist

The Evaluation Process - Key Questions

Evaluation Plan:

• If an evaluation plan existed, was it used?
• Has the criteria used to select the programme been stated?

Establish Scope and Purpose of the Evaluation:

• Has the coverage of the programme been defined?
• Have the questions the evaluation is seeking to address been stated?

Establish Rationale Aims & Objectives of the Programme:

• Has the rationale for the programme been made explicit?
• Has need being addressed?
• Has the form of market failure &/or social equity been determined?
• Have the aims and objectives of the programme been clearly stated?

Specify Measures & Indicators:

• Have the following been identified?
  1. need indicators
  2. target groups
  3. all public & private sector inputs
  4. the main activities of the programme
  5. output and outcome indicators
  6. Have the three 'Es' been addressed?

Establish A Base case for Comparison With Actual Outcome:

• Has a base case been established?
  1. control groups
  2. 'before & after' comparisons of the policy affected group?

Define Assumptions:

• Have cause and effect links been examined?
• Have external factors influencing the operation of the programme been identified?

Identify Side Effects & Distribution Effects:

• Have externalities been considered and quantified where possible?

Analysis:

• Have both quantitative and qualitative approaches been considered ?
• Has the base case been compared with the actual outcome to measure net additionality ?
• Have deadweight, displacement and multiplier effects been calculated ?
• Has a conclusion been reached as to whether the programme is achieving VFM i.e. is it effective, efficient and economic?

Outcome of Evaluation:

• Have recommendations been made regarding the future of the programme: continuation; modification; succession; termination?
• Have all major uncertainties been identified?
• Has sensitivity analysis been carried out?

Presentation & Dissemination of Results:

• Have the results of the evaluation been adequately presented?
• Have the results of the evaluation been adequately presented?
• Has it been made clear who will receive the results of the evaluation?