Evaluation Guidelines and Tools

Work programme

OPEV’s work programme is presented in the proposed Three Year Rolling Work Programme for the Operations Evaluation Department (OPEV) for the years 2009 to 2011. The programme builds on the Bank Group’s strategic priorities, articulated in the ADF XI Governors’ Report and the Bank Group’s draft Medium Term Strategy. It outlines the human resources and financial resources required to deliver the programme.

Evaluation Methodology

• Evaluation Approach: The preparation of an “Approach Paper” (sometimes referred to as Concept Paper or Issues Paper) precedes commencement of full-scale work for the preparation of an evaluation. Its purpose is to identify and conceptualize the objective of the evaluation study, set out the issues, expected focus and outcome, key questions and evaluation methods, data collection methods, sources of information and propose for approval a schedule of activities, requirement of resources, and communication and dissemination of findings and recommendations. The Approach Paper is sent for comments to all parties directly involved in the evaluation and is publicly disclosed and posted onthe website. This helps to ensure that the evaluation process is transparent to all stakeholders and helps coordinate their inputs and participation according to a realistic timetable.  

• Conducting the Evaluation: To ensure the smooth implementation of independent evaluations, Bank management ensures that OPEV has free access to the documents and information it needs. Operational staff is required to provide OPEV with all relevant operations documentation and information and cooperates actively in the evaluation process. To improve the quality and credibility of evaluation reports, a review peer process is used, starting from the evaluation design and continuing through preparation and reporting. Consultants are used in areas where OPEV lacks expertise, or has insufficient capacity, or when there is need for innovative evaluation methods and approaches, or for input from independent external evaluators/peer reviewers.
• Evaluation Field Mission: Field missions help to guarantee the quality and impartiality of the evaluation evidence. It is the main way in which participatory methods can be applied and changes resulting from the project/program, ultimate beneficiaries, and project’s strengths and weaknesses identified. Triangulation and validation of data generated through different sources is used to compare the information gathered with opinions of key informants and information from other secondary sources. Evaluation missions present and discuss a “Debriefing Note” containing preliminary field mission findings in order to ensure accuracy and appropriateness with evaluation stakeholders and development partners. 
• The Evaluation Report: OPEV shares draft reports with management and borrowing country’s authorities, implementing agencies and co-financiers. As a general rule, only comments on factual errors and inaccuracies are corrected in the draft report.