DIPECHO 8 Consortium Project’s Final External Evaluation

Background

The project “Inclusive Community Based Disaster Risk Management (ICBDRM) for a Resilient Sri Lanka” started in February 2015 and is implemented by a consortium formed by Handicap International, ACTED, Oxfam and Save the Children. This 18-months project, funded by the Disaster Preparedness programme of ECHO (DIPECHO), aims to contribute to build resilient communities in Sri Lanka through inclusive community and school based DRM models, and more specifically to build the capacities of the Government to replicate these inclusive CBDRM and SBDRM models within the framework of Sri Lanka Comprehensive Disaster Management Program (2014-18) and Education Sector Development Framework and Programme (2012-2016). The DIPECHO 8 project is a continuation of two previous DIPECHO cycles in Sri Lanka, and is the second DIPECHO cycle implemented with the same consortium.

Three expected results are foreseen at the end of the project:

• Result 01: A sustainable model of inclusive CBDRM promoting national priorities is institutionalized by the Government.
• Result 02: Systems and technical capacities of MDM and MoE to replicate inclusive CBDRM and SBDRM with national to local stakeholders are enhanced.
• Result 03: The inclusive CBDRM model is being replicated by the Ministry of Disaster Management (MDM) and the Ministry of Education (MoE) in Mullaitivu and Kilinochchi Districts with the technical support from the project.

The Consortium had two main levels of intervention during the timeframe of the project:

• at national level where the project (under Result 1) supported the Disaster Management Center (DMC) of the Ministry of Disaster Management with the development of an inclusive CBDRM model, and the Ministry of Education which received support to revise the School Disaster Safety Guidelines (from 2008);
• and in the districts of Kilinochchi and Mulaitivu – where the new models could be tested (under Result 3), in a total of 20 Grama Niladari (communities) and 16 schools, once all key government partners had been trained (Result 2).

Objective of the Consultancy

With the project now coming to an end, a final external evaluation is considered that shall:

• assess the quality of the project;
• provide a clear view on the project’s achievements;
• evaluate the coordination mechanisms used with the national authorities, local and international organisations and all relevant actors;
• analyze the impact of the project at national and sub-national levels;
• develop practical recommendations for a possible follow-up of the DRR activities in Sri Lanka.

Specific Objectives of the Evaluation

In its evaluation report, the consultant is expected to:

1. provide a brief description of the project,
2. compile the findings of the evaluation as per the criteria presented below,
3. and draw-up operational recommendations to the consortium agencies for the possible continuation of community based DRR/ school Safety activities in Sri Lanka.

More specifically, the consultant is expected to provide an analysis of the quality of the project based on the following criteria:

Relevance of the project:

• To what extent the project was adapted to the context (political, socio-economic situation, disaster preparedness trends, and available DM capacities at national and sub-national levels)?
• Did the strategy of the project take into account the different needs of different types of disabilities and of vulnerable groups?
• Was the project coherent with other interventions in DRM sector and so, ensured a comprehensive approach in this sector?

Effectiveness:

• Were activities implemented as planned? To what extent the project was able to adjust to the context’s evolution?
• Were project’s results (including target indicators) achieved and did it contribute to reach the objectives?

Efficiency:

• Did the intervention method achieve the expected results at the lowest cost?
• Were the necessary resources mobilised and optimised throughout the project?
• This analysis should cover: planning of activities, and elements such as logistics (in particular in the field), selection of suppliers (for example for the First Response Kits), etc.

Coordination and Management:

• Were responsibilities and roles divided between HI and implementing partners in the best possible way?
• Were implementing partners kept regularly informed and involved in decision-making processes concerning the project's steering and implementation?
• Was the organization of the coordination efficient to reach the objectives and results under the budget and time constraints?
• Were the stakeholders (national and local authorities, local and international organizations) actively contributing towards the project's success?

Impact and Changes:

• Did the project bring about positive short- and medium-term changes in the DRM sector in Sri Lanka at both national and sub-national levels?

Sustainability:

• Have the project’s activities been transferred to other stakeholders including the DRM authorities?
• Are resources (financial, physical and human) identified and mobilized by DRM authorities to support the follow up of the project’s activities?

Work Plan and Methodology

The evaluation shall consider the following activities (but should not be limited to):

• An induction briefing with the four Consortium members in Colombo, during which the information and documents necessary for the mission will be provided – such as project documents (narrative and financial proposal, logical framework, work plan, intermediary reports, as well as other documents relative to the running of the program);
• A review of main secondary data, among others: Sri Lanka Comprehensive Disaster Management Programme (SLCDMP 2014-2018), GN Disaster Preparedness and Response Plan format (UNDP 2006), Standard Operating Procedures for Floods Early Warning System, Guidelines for school level planning, Sri Lanka minimum standards for Education;
• A series of bilateral meetings or Focus Group Discussions with the main stakeholders involved in the activities of the project; the consortium will support the consultant in arranging the meetings with in particular: Director General of DMC, the SLCDMP unit, the focal point for School Safety at MoE, the National Institute of Education (NIE), the District Disaster Management Units (DDMUs), the district planning departments, the Zonal Education DRR coordinators;
• Field visits in at least 50% of target GNs and Schools, in the districts of Kilinochchi and Mulaitivu;
• The submission to the consortium, at the end of the first week, of an inception report presenting the main information gathered, as well as the proposed evaluation criteria and the tentative schedule for the stakeholders’ meetings and the field visits;
• A debriefing with the consortium members at the end of the mission in Sri Lanka, to discuss the preliminary results/findings;
• The submission of the draft evaluation report and after comments are provided to the consultant, of the final report.

Role of the Consortium

• Provide logistical support, including arranging meetings as requested by the evaluator and providing transport for use during the evaluation.
• Provide a translator when visiting the field;
• Make available all relevant documents to the evaluator.
• Provide working space, access to the internet, and office services (copies, etc.) in Colombo as well as in Kilinochchi.

Selection Criteria

• The evaluator must meet the following requirements:
• Relevant experience and or academic background (Master Degree in community development, DRR or related)
• Relevant field experiences in community based disaster risk reduction
• Proven experiences in external evaluations in the technical field of DRR
• A high level of understanding and analysis of community development
• Experience working with community organisations and national NGOs
• Experience of working/coordinating with government (experience with the NDMO preferred) 
• Previous experience in writing Evaluation Reports for international donors (DIPECHO experience preferred)

Personal Attributes & Skills (highly desirable)

• Excellent English communication skills both oral and written
• Experience in South Asia, and specifically Sri Lanka will be an asset
• Experience working effectively with people of different cultures
• Able to work under pressure, meet deadlines and prioritise workloads
• Excellent analytical skills
• Flexibility, patience and ability to work with a translator
• Experience of travelling and working in remote locations and with basic facilities