Terms of Reference

Final Evaluation

GFFO project

Background                                

Oxfam is leading a two-year multi-sectoral project to respond to humanitarian crises affecting the Somali community. The project, funded by GFFO and implemented by Oxfam and KAALO, aims to provide lifesaving support to men, women, and children in rural areas under regions of Sool, Sanaag in Somaliland, and Bari and Nugaal in Puntland. It aims to integrate access to lifesaving food, water, and sanitation, improve protection assistance, and cope with drought and other disasters.

The project has the following sectors and activities to cover within a period of 24 months:

·         Food security interventions: multipurpose cash assistance in the form of social safety nets, UCT or CFW, agricultural support, locust control, and livestock vaccinations.

• WASH activities: rehabilitation and solarization of water sources (powering pumping systems with solar power), water trucking (Cash for Water), desalination, hygiene promotion, and distribution of hygiene and menstrual hygiene management items.
• Protection activities: strengthening community-based protection mechanisms such as women’s fora and protection committees, awareness raising and gender/protection assessments, and the distribution and installation of solar lighting.

Project direct beneficiaries includes 57,000 people (9.500 households) affected by drought and other socioeconomic impacts (limited trade opportunities, loss of income, etc.); and includes 50% IDPs (urban and rural) and 50% agropastoral and pastoralists.

The overall objective of the project is to save lives, improve welfare and maintain dignity of the targeted Somali population.  To achieve this objective, the below outcomes were described:

Outcome 1: Improve access to food and income for vulnerable women, men, girls and boys through immediate life and livelihood saving assistance and livelihood recovery support through cash and market-based approaches.

Outcome 2: 37,600 IDPs and most vulnerable host communities have improved access to safe water supply and improved hygiene practices for men, women and children living in IDP settlements and rural areas of Somaliland and Puntland.

Outcome 3:  21,000 individuals of crisis-affected women, men, boys, and girls in target communities have strengthened protection capacities and improved safety and dignity through a community-based protection response.

Purpose of the final evaluation

As the project is phasing out, Oxfam is committed to undertake an independent final evaluation, critically assessing each component's impact on target groups and beneficiaries.

Specifics objectives of the midline survey includes:

ü  To document and assess the outcomes and immediate changes achieved through the implementation of the project.

ü  Collection of quality data required to inform outcome level indicators.

ü  Identify and capture significant and planned and unplanned changes resulting from the interventions, as well as the actors and processes that contributed to these changes.

ü  To evaluate the effectiveness, efficiency, and sustainability of the FSL interventions, WASH activities, and gender and protection activities implemented.

ü  To capture key lessons learned, best practices, and areas for improvement in the response.

ü  To provide recommendations for future programming and policy development in similar contexts.

Methodology

The consulting firm or team will propose a participatory, evidence-based midline evaluation using qualitative and quantitative data collection methods. Key steps include:

        i.            Desk review: Conduct a comprehensive review of relevant project documents, reports, and available data covering project components.

1. Key informant interviews: Conduct interviews with key stakeholders, including community members, implementing staff, local authorities, and beneficiaries, to gather qualitative data on the outcomes and changes achieved.
2. Field visits: Undertake field visits to selected project sites to observe the implementation of interventions, interview beneficiaries, and collect visual evidence.
3. Data analysis: Analyze the collected data to identify patterns, trends, and key findings related to the outcomes achieved, effectiveness, efficiency, and sustainability of the response.
4. Report writing: Create a comprehensive report analyzing midline evaluation findings, lessons learned, best practices, improvement areas, and recommendations for future programming.

Scope

The midline evaluation will be conducted specifically targeting the regions of Sool and Sanaag in Somaliland, Bari and Nugaal in Puntland, and Dayniile and Kahda in SC Somalia where the response is being implemented by Oxfam and its local partners KAALO and SSWC. Around 80% of project sites will be visited during the data collection. The evaluation will cover the period 01 April 2022 to 31 March 2024.

The project’s performance will be assessed with strict regards to the following 4 evaluation criteria and will mainstream gender:

Results achieved: The evaluation report will assess the overall performance of the GFFO project against selected OECD DAC criteria and the Core Humanitarian Standards, ensuring accountability towards the donor, GFFO, and the beneficiaries of the program. The consultant is expected to work with Oxfam & partners to gain insight into the achievement of targets.

Accountability to affected populations: Evaluate to what extent relevant information on the program and partner organization has been shared with the communities; to what extent communities were able to participate in all phases of the project cycle (from design up to evaluation processes); to what extent communities were aware and have made use of feedback mechanisms and to what extent partners were able to close the feedback loop.

Collaboration: Evaluate to what extent the collaboration between GFFO partners contributed to reaching beneficiaries and targets in a more effective, efficient, relevant and timely manner, as set in the log frame and in the narrative proposal. In addition, evaluate to what extent the collaboration between GFFO partners has led to increased positive impact on the lives of the beneficiaries.

Learning: Evaluate to what extent the adaptive management system and learning strategy of the project was effective.

Key Evaluation Questions

Through the process of assessing the final evaluation of the project, the achievements against projects objectives and outcomes would be determined. We have listed a range of possible questions below.

The consultant in consultation with Oxfam is expected to propose a selection of the most relevant questions as part of the inception report. The questions should cover the 4 proposed evaluation criteria.