Evaluation consultant

Background

CARE Australia, along with CARE International in Vanuatu, has made a commitment to undertake an end of project evaluation of the ‘Improving Community-Based Emergency Preparedness’ Project. The disaster risk reduction (DRR) project works with selected communities to build their capacity to prevent or mitigate, prepare for, respond to, and rebuild after a disaster. In addition, the project has taken every opportunity to work with other local organizations, NGOs and government bodies in community based emergency preparedness activities. Funded through AusAID, the project commenced in mid 2008 and is due for completion in November 2011.

The project incorporates three inter-related strategies:
1. To build community capacity to prevent and withstand the potential effects of disaster
2. To strengthen community preparedness for disaster in high risk areas
3. To build the capacity of local organisations to prepare for and respond to disaster
The project is being implemented in 19 communities on four islands: Maewo, Futuna, Santo and Vanua Lava

The purpose of the consultancy is to conduct a participatory review of the effectiveness/ efficiency, and impact/sustainability of the DRR project:
1. To assess the degree to which the project is achieving its objectives against the design
2. To review project outcomes against key program principles, including;
- Partnership
- Sustainability
- Promote organisational learning
3. To draw out lessons learnt/provide recommendations for future programming
4. To capture CARE’s achievements within an Activity Completion Report for submission to AusAID. (see Annex 1)

Scope

The Evaluation Consultant will review activities undertaken and outputs achieved during the nearly 3.5 years of project implementation.
The objectives of the evaluation are as follows:

The evaluation will measure the impact of the DRR Project among the target beneficiaries and will report on achievement of objectives and specific project targets set out in the logical framework and proposal. Internal reports will also provide more specific information on sub-activities, and their outcomes.

• Assess the project performance towards the fulfillment of the specific objectives of the project;
• Assess the relevance of the project in the context of Vanuatu’s national priorities;
• Assess the effectiveness and efficiency of the project;
• Assess the impact and sustainability of the project;
• Lessons learned of the project and recommendations for future attention of CARE, government and donors;
• Measure the indicators as provided in the logical framework of the project.

Specifically, the evaluator will assess against the following evaluation criteria (with sample questions):

Relevance of the Project:
• How well did the project align with the national plan and priorities of the government?
• How well did the project respond to local needs and the overall context?
• How well did the project build on existing strengths and capacities to respond to local needs?
• What adaptations were made to fit the realities of the local context?

Effectiveness:
• To what extent did CARE promote technologies that were appropriate to target beneficiaries to increase DRR awareness, planning and preparedness;
• To what extent current staffing structure were appropriate in relation to implementing activities;
• To what degree has DRR awareness, planning and preparedness increased among vulnerable beneficiary households?
• What has changed in the behaviour of target beneficiaries (women & men) in terms of DRR awareness, planning and preparedness?
• To what degree was project learning/good practices shared with other communities, provincial government, NDMO and related stakeholders and NGOs concerned?
• To what extent have beneficiary households mobilized local strengths and resources to respond to local issues, contribute to discussions and decision making on policy issues?
• To what extent has communities been able to draw attention of external stakeholders to local needs and priorities?
• To what interventions, approaches, practices or technologies do beneficiaries (women & men) and communities attribute the observed changes in their DRR awareness, planning and preparedness and overall well-being?
• How far has equality been achieved between women and men and between other vulnerable groups?
• To what degree has CARE’s collaboration/partnerships with national and provincial level organizations contributed to achieving the project goal;
• To what degree is the project succeeding in enhancing micro-macro linkages through partnerships with government and civil society;

Efficiency:
• How were beneficiaries, communities, partner NGOs, government involved in decision-making about changes in project priorities?
• How well did the project ensure the timely and on-budget delivery of outputs?
• How well did the project ensure the contribution of partner NGOs and government in the delivery of outputs?

Impact:
• How has the project, based on its evidence, contributed to set government and donor policies for replication of its learning and good practices?
• What recommendations can be given for future actions?
• What changes in community member's practices, ideas and beliefs has occurred in regard to DRR awareness, planning and preparedness?
• How has the provision of training, tools and inputs benefited households and groups?
• How have neighboring communities and provinces benefited from project interventions?
• How has the project contributed to the growth and development of groups, partner NGO/government staff and other stakeholders?
• How has the formation of groups contributed to social cohesion and economic viability?
• How has the project contributed to demonstrate and establish innovative technologies and approaches on DRR awareness, planning and preparedness?
• How has the project contributed to the promotion of gender equality?

Key Tasks

• Comprehensive review of project data and related documents made available by CARE Vanuatu and CARE Australia;
• Development and utilization of evaluation tools for the Final review of the CARE project in Futuna and Maewo islands based on the outputs specified;
• Conduct field visits and facilitating participatory evaluations (CARE to identify and arrange meetings with government officials, community representatives, and other relevant stakeholders. CARE will arrange all logistical needs for field visits)
• Discussions with key project staff (Port Vila based international & national staff)
• Following the field visits, debrief will be conducted with program management, partner NGOs and key stakeholders (NDMO) to review the findings of the field work.
• Analysis of the data and submission of final evaluation report and recommendations, as well as Activity Completion Report for submission to AusAID (CARE will share the report with program participants, partners, government, INGOs and other stakeholders)

Selection Criteria

• Relevant experience and or academic background (Masters Degree in community development, DRR or related);
• Experience with participatory monitoring and evaluation methodologies;
• A high level of understanding and analysis of rural/community development particularly in DRR;
• Experience in developing and implementing a project review (AusAID experience preferred);
• Experience in developing and implementing a project review that includes aspects of gender equity;
• Experience of working/coordinating with government, in particular NDMO;
• Previous experience in writing Evaluation Reports and Activity Completion Reports for international donors (AusAID experience preferred).

Personal Attributes & Skills (highly desirable):

• Excellent English communication skills both oral and written;
• Experience in Pacific, and specifically Vanuatu preferred;
• Experience working effectively with people of different cultures;
• Able to work under pressure, meet deadlines and prioritize workload;
• Excellent analytical skills;
• Flexibility, patience and ability to work with a translator;
• Strong commitment to social justice and gender equity
• Experience of traveling and working in remote locations and with basic facilities