Terms of Reference for Consultancy Service to Conduct Project Final Evaluation for MIDEEYE Project

Date of issue:  2nd December, 2024

Duration of the assignment  45 day (s)

Project title:  12207 - MIDEEYE Project: Support of the National Reconciliation and Local Governance in Somalia

Evaluation target locations

·         Banadir Regional Administration (BRA) / Mogadishu

·         Southwest state (SWS); Baidoa, Barawe and Hudur

·         Hirshabelle state; Adale, Mahas, Jowhar, Warsheikh

·         Galmudug state; Dhusamareb, Abudwak, Balanbale, Guriel, Hiraale

Deadline for submission of offers:  23rd December 2024 at 5:00 P.M. (East Africa Time Zone)

Contracting authority:

FCA Somalia Country Office

Contact: Procurement Committee

E-mail: [email protected]

1. Introduction & Context

FCA Somalia Country Office is looking for qualified consultant(s) to undertake project final evaluation for the project Support of the National Reconciliation and Local Governance in Somalia (MIDEEYE).

FCA is the biggest development and humanitarian aid organization in Finland. FCA is currently operating in 13 countries in Asia, Africa and Middle East and is specialized in three thematic priority areas: Right to Peace (R2P), Right to Livelihood (R2L) and Right to Quality Education (R2QE).

In Somalia, FCA began its operation in 2007 through support to peace building initiatives in Somaliland and Puntland. Following the success of the interventions, FCA Somalia expanded its operation to other parts of South Central of Somalia in 2013, evolving from community level peace building initiatives to state building and state formation interventions at FGS and FMS levels. FCA Somalia also facilitated the state formation process between 2014 and 2015 which resulted in the formation of the Galmudug State.

The project is designed based on years of experiences of FCA and NRTP in Somalia in strengthening inclusive and accountable national and local governance structures, promoting active and meaningful participation of women and youth in state and peacebuilding processes, and supporting reconciliation at community, district, state, and federal levels.

At the request of the Somali government and with the generous financial support of the Ministry for Foreign Affairs of Finland (MFA Finland), the FCA Somalia together with the Network for Religious and Traditional Peacemakers (NRTP) hosted by FCA, provide support via MIDEEYE project to the Federal Government of Somalia (FGS) in their efforts to advance the implementation of the National Reconciliation Framework (NRF) and the National Wadajir Framework supporting establishment of inclusive local governance in Somalia.

2. Background info on MIDEEYE project

MIDEEYE project implementation period is 45 months between April 2021 and December 2024, with a total budget of 4.5 million EUR, fully funded by MFA Finland, as part of MFA Somalia Country Strategy (2021-2024) implementation. The project is co-implemented by FCA and NRTP, hosted by FCA. FCA Somalia is responsible for the overall management and coordination of the project and key stakeholder relations. NRTP has extensive expertise in peacebuilding, mediation, and reconciliation at the national, regional, and global levels, FCA Somalia has extensive experience promoting stability and building good governance in Somalia through successful formation of district councils and supporting administrations across FMSs.

The project directly contributes to attaining MFA Country Strategy (2021-2024) Impact Area 1 on improved confidence in the state and increased social cohesion for a renewed social contract, Pillar I on Inclusive and Accountable Politics and Reconciliation of the 9th NDP (2020-2024) and the National Stabilization Strategy. The initiative is contributing to FCA/NRTP Global Strategy and FCA Somalia Country Strategy and Action Plans under its Right to Peace thematic area. The initiative is aligned with the Provisional Constitution of FGS which indicates the needs to foster social healing, reconciliation and unity and establish the True Reconciliation Commission (TRC). The project also contributes to the SDG 5 on gender equality and SDG 16 on peace, justice, and strong institution.

2.1 Implementation approaches:

·         The formulation of the intervention is built on the foundations of Rights-Based Approach (RBA) and Do No Harm principle with specific focus on gender equality and social inclusion of women, youth and marginalised groups, and conflict sensitivity.

·         The project places a strong emphasis on bottom-up approach and Somali-led, owned, and driven process, directly responding to aim of NRF and the Wadajir Framework. The MIDEEYE project will be implemented in FGS including Banadir Regional Administration (BRA) and with a strong geographical focus at the state and district levels.

·         Close partnership with Ministry of Interior, Federal Affairs and Reconciliation (MoIFAR) and Ministry of the Interior (MoI) of target FMS is ensured in the project implementation to strengthen national ownership and leadership. Partnership with existing local partners, relevant state institutions and other local NGOs is operationalized to implement reconciliation and DCF interventions, and peace dividends in selected districts.

·         A strong collaboration and coordination between different stakeholders are being promoted also via the existing mechanisms such as NRF Advisory Board, that the project supports.

The project aims to promote national reconciliation and strengthen inclusive governance and administration in Somalia, contributing to renewed social contract which is built on trust in the state, social cohesion, and a shared vision of a common future among Somali people.

2.2 Project outcome and output areas:

Project objectives are achieved through two outcome areas and three output areas under each:

Outcome 1: Increased national capacity to effectively implement and operationalize National Reconciliation Framework (NRF) in the Federal Government and selected Federal Member States (FMS) to build legitimacy and trust in government institutions

·         Output 1.1: Improved capacity of MoIFAR in effectively coordinating and monitoring the implementation of NRF

·         Output 1.2: Enhanced capacity of MoI for effective roll-out of NRF in selected FMS

·         Output 1.3: Increased advocacy for genuine reconciliation and dialogues on establishment of the True and Reconciliation Commission and for the promotion of a shared vision of a common future, peace, and national unity

Outcome 2: Strengthened inclusive governance and administration for effective basic service delivery in selected FMS, in accordance with NRF and Wadajir National Framework for Local Governance.

·         Output 2.1: Increased legitimacy and inclusive governance of target districts through enhanced local capacity and inclusive and gender sensitive reconciliation mechanisms

·         Output 2.2 District councils and administrations are formed, integrating gender and youth in decision making process

·         Output 2.3: Increased legitimacy and trust in the state and district government through social integration programmes and peace dividend initiatives

Project supports and is based on a close collaboration with Ministry of Interior, Federal Affairs and Reconciliation (MoIFAR) and Ministries of the Interior (MoIs) of target FMS and Ministry of Reconciliation and Peacebuilding (MoRaP) to ensure in the project implementation strengthens national capacities in line with national priorities and is guided by the strategic leadership of the relevant duty bearers.  Furthermore, the project works with and collaborates with existing local partners, relevant state institutions and other local NGOs to implement reconciliation and District Council Formations (DCF) interventions, and peace dividends in selected districts.

2.3 Project scope and target groups

Geographical scope and target locations
The project supports national level institutional capacity strengthening and policy development and coordination regarding NRF and Wadajir Framework. Additionally, the project has selected FMS and target districts that evaluation is expected to cover:

·         Banadir Regional Administration (BRA) / Mogadishu

·         Southwest state (SWS); Baidoa, Barawe and Hudur

·         Hirshabelle state; Adale, Mahas, Jowhar, Warsheikh

·         Galmudug state; Dhusamareb, Abudwak, Balanbale, Guriel, Hiraale.

Project beneficiaries and target groups:

In achieving the project objective, MIDEEYE targets the following direct beneficiaries who directly participate and benefit from different interventions of the project:

·         MoIFAR in FGS, and MoI and district councils and administrations in selected FMS: will benefit from capacity building, mentorship and technical assistance from seconded advisor and technical coordinators and other tailored supports.

·         Traditional and religious leaders: will be specifically engaged to lead community social healing, reconciliation, conflict management and DCF, and act as peace ambassadors

·         Female leaders, peacemakers/peace mothers and local mediators and existing women’s networks in target districts will be equipped with peacebuilding, inclusive governance, and leadership skills 

·         Male and female youth from key universities and communities in the target FMS and minority and traditionally marginalized clans will participate in the peace circle trainings, civic education, social healing, and reconciliation dialogue platforms

·         Other target groups: policy makers, civil society, community members, academic institutions, business, and media professionals will participate in coordination meetings, reconciliation, civic education, dialogues, and awareness campaign

The project aim was to give priority to women and youth in all project activities and ensure inclusiveness and participation of the marginalized clans and groups. The project strived for 30% of women and 30% youth participation in all project activities and in key decision-making structures, aligning with FCA’s Gender Equality Strategy.

The final beneficiaries of the project are the affected community members in the target areas at large who are expected to enjoy safe, peaceful, and stable community and society as results of the direct and indirect impacts of the project.

3. Objective and expected scope of the Project final evaluation

The evaluation is an essential opportunity for FCA and to NRTP to gather insights to inform future programming. Evaluation findings and the best practices will be promoted via internal organisational learning practices such knowledge sharing sessions into FCA’s long-term strategy for Somalia, Right to Peace (R2P) approach and, where relevant, across other regions. FCA will promote the best practices via its advocacy efforts towards duty bearers, right holders, and wider community of practise, to promote joint learning.

·         The project final evaluation will focus on how the project achieved its objectives, targets, and the level if impact it created.

·         Assess the relevance and strategic positioning and intervention logic of the project to respond and provide support to the overall peacebuilding and establishment of inclusive local governance needs in Somalia.

·         The evaluation is expected to cover the entire project implementation period 45 months implemented between April 2021 to December 2024; in its full scope described under sections 1 and 2. This includes identifying results and analysing the impact in regard to the key national policies and strategies, and MFA Country Strategy (2021-2024) Impact Area 1 on improved confidence in the state and increased social cohesion for a renewed social contract, project intervention, is supporting to implement.

·         The evaluation is expected to cover the geographical scope and target groups of interventions as defined in the section ‘Geographical scope and target groups.

·         The evaluation will assess the project’s relevance, effectiveness, efficiency, impact (intended and unintended) and sustainability/catalytic; identify and document evidence-based findings including best practices and challenges.

·         Based on evidence-based findings, the evaluation will provide the project implementing partners and key stakeholders with actionable recommendations to inform the design and implementation of other related ongoing and future projects in line with relevant policy frameworks, including FGS.

·         This final evaluation will provide FCA, NRTP and key national stakeholders in the FGS, and civil society partners, with an impartial assessment of the results that the project has generated to date on gender equality and women’s empowerment; and social inclusion; different social groups, marginalized groups including minority clans (GESI).

·         Evaluation is expected to cover both outcome areas of the project; and the six output areas under these.

·         The evaluation will assess indicators of potential impact and sustainability of results including the contribution to capacity development and achievement of sustainable development goals.

4.  Evaluation methodology and process

In line with the OECD DAC evaluation criteria the project final evaluation will comprehensively review the outcomes documented during the project life cycle and verify them with different categories of target actors involved in the project. It is expected that the independent evaluator will engage the project team, partners, and sampled target actors and project beneficiaries in identifying, documenting and verification of the significant outcomes realized during the project implementation period. The project final evaluation methodology will adopt mixed method of qualitative and quantitative through participatory manner to strengthen the evaluation process.

In a nutshell, the project final evaluation will be collected in the following ways:

*        Review the project documents including but not limited to project documents, progress reports, results framework, MEAL data, publications, financial reports, and other relevant products.

*        Review of the key national policy frameworks and other strategies and project supports FGS to implement, with special focus to NRF. Also, review of the MFA Finland country programme the project implements.

*        A collaborative approach to engage staff, partners, other key stakeholders, partners, government, as appropriate in design, implementation, and in writing evaluation report.

*        A participatory evaluation with emphasis on capturing a cross-section of views from target groups, multi-stakeholder quantitative and qualitative techniques including in-depth individual interviews, key informant interviews, focus group discussions, observations and story of change documentation, and others as appropriate.

*        The evaluation is expected to be gender-sensitive, rights-based, inclusive, culturally sensitive and comply with professional ethical standards.

*        Collect at least 12 stories of change (ideally, two from each district) based on outcomes, to be included as annexes to the final evaluation report.

The project final evaluation’s methodology and methods must be described by independent evaluator(s) in the expression of interest, by clearly outlining how practically the consultant(s) will be used during the data collection.

The analysis, approach, and methods should adhere to FCA’s conflict and gender sensitivity approaches and community security model and strive for simplicity in design with practical application. The analysis, approach, and methods should be participatory, whereby team members, partners, and participants are involved throughout the process.

5.  Key evaluation questions

This project final evaluation will be carried out I line with the OECD DAC evaluation criteria. The focus will be on aspects of relevance, effectiveness, efficiency, and sustainability. The criteria definitions and expected key research questions are detailed below. The evaluator may adjust or add to the below questions, in consultation with FCA, to ensure sufficient data is collected and evaluation objectives met.

Relevance: The extent to which the objectives of intervention were consistent with beneficiaries' needs, country priorities and policies. The analysis of relevance will focus on the following areas in relation to the design of the project:

*        Review the relevance of the project to the national development plan -NDP9, the Wadajir National Framework, national reconciliation framework (NRF), needs regarding civil society development, among other relevant reports and policies.

*        Project has particular emphasis on ensuring local ownership and Somali-led approaches. The evaluation assesses how the project, and the implementing approaches have been successful in achieving these objectives, and the key challenges and successes.

*         The project has particular focus the meaningful inclusion of women, youth, and marginalised groups such as minority clans and internally displaced people across activities in target districts, particular focus is given to supporting the inclusion to reconciliation processes and supporting inclusive political participation. Evaluation will assess the extend the objectives have been reach and identify the key challenges.

*        Particularly, analyse changes in project related context and adaptation and respective changes in project implementation accordingly (e.g., change of project co-applicant coalitions, and changes in policy processes supported).

*        Review the alignment of the project interventions and strategic positioning with the federal government of Somalia’s MFA-Finland and FCA country strategies.

*        Review the relevance of the project intervention to the problems to be addressed, needs and priorities of civil society actors, key target groups, and key stakeholders based on the feedback from beneficiaries, though FCA Somalia’s relevant feedback mechanisms.

*        Review of the project’s ability/alignment with the promotion of the Gender Equality & Social Inclusion (GESI) approach for sustainable reconciliation and good governance.

Effectiveness: How effective was the project in achieving its specific objectives. The analysis of Effectiveness will focus on issues such as:

*        Review what results have been achieved versus the targets in the logframe and identified problem to be addressed.

*        Review how effective has been the logic of intervention combining the two outcome areas on reconciliation and local governance support to receive desired impact

*        Review how the approaches and strategy have contributed to the successes or handled the challenges of the project.

*        Review how the project managed challenges and stayed transparent.

*        Review whether there have been any unexpected results and how they have affected the target beneficiaries.

*        Innovation: Assess the project's ability to introduce new and creative approaches or solutions to address challenges.

*        Review how coordination among stakeholders, among governance programs/projects and synergies with other project / program (if any) have been manifested and contribute to the project effectiveness.

*        Participatory: Assess the degree to which the project involves and empowers local communities, allowing them to actively contribute to decision-making and implementation processes.

Efficiency: How well has the project transformed available resources into achieving the intended objectives and creating outcomes observed, and the quantity, quality, and timeliness of associated outputs. Comparison should be made against what was planned. The assessment of efficiency will therefore focus on elements including:

*        Review how the project intervention and strategy (i.e., capacity building, multi- stakeholders’ partnership, and others) has transformed available resources to expected outcomes in terms of quantity and quality.

*        Review how the project has overcome unforeseen difficulties, update with new situation to deliver project outputs within budget.

*        Review the project budget utilization and absorption performance at the end of the project implementation, and how much were the existing resources like staffing to helped deliver project results

*        Review the project's ability to be cost effectiveness, were existing resources used efficiently and were project procurement done using cost-effective methods such as value-for-money, how were local resources used for more efficient approach, etc.

*        Review much the coordination and complementary roles of the FCA and NRTP have contributed to the efficiency of the project implementation. Feasibility: Evaluate the practicality and achievability of the project within the given constraints, including financial, technical, and resource aspects.

Impact: The evaluation will assess how the project reached the outcomes and outputs set in the project logical framework, using the outcome and output indicator data for measurement, including the contribution to capacity development and achievement of sustainable development goals.

*        Review contribution to the overall objective of the project: ‘Promote national reconciliation and strengthen inclusive governance and administrations in Somalia, contributing to renewed social contract which is built on trust in the state, social cohesion and a shared vision of a common future among Somali people’.

*        Review to what extent the project achievements contribute to increased civic space relation to DCF process, social reconciliation, and inclusive governance.

*        Review how the project managed challenges and stayed transparent.

*        Inclusivity: assess in terms of inclusivity the efforts undertaken and their impact to enhance meaningful participation of women, youth and marginalised groups such as minority clans or vulnerable groups such as internally displaced people (IDP).

*        To assess the impact of the capacity strengthening activities to meaningfully support the project reaching its targets to support meaningful engagement of women, youth and marginalised groups such as minority clans or vulnerable groups such as internally displaced people (IDP).

*        Transparency: Examine the openness, accountability, and accessibility of information and decision-making processes.

*        Adaptability: Assess the project's capacity to respond to changing circumstances and adapt its strategies or activities accordingly.

*        Legitimacy: Evaluate the project's alignment with legal frameworks, regulations, and ethical standards.

*        Resilience: Assess the project's ability to withstand and recover from shocks, disruptions, or uncertainties.

*        Equity: Assess the fairness and distribution of benefits among different stakeholders and communities.

Coordination: evaluate how much the project has coordinated with relevant actors to ensure seamless implementation, participation/inclusion, ownership and legitimacy of the project.

*        Review how coordination among stakeholders, among governance programs/projects and synergies with other project / program (if any) have been manifested and contribute to the project effectiveness.

*        Collaboration: Evaluate the level of cooperation and partnership with relevant stakeholders, including government agencies, NGOs, communities, and private sector entities.

*        Participatory: Assess the degree to which the project involves and empowers local communities, allowing them to actively contribute to decision-making and implementation processes.

*        <

Required Expertise and Qualification

§  Demonstrated experience in conducting project final evaluation, assessments, research, and baseline reviews on governance and reconciliation related projects in Somalia context.

§  In-depth knowledge of the Somalia context, and knowledge of conflict, political, economic and security processes and approaches.

§  Minimum 10 years of experience in monitoring and evaluation for the lead consultant, with particular focus on quality tools development, qualitative and quantitative data analysis and exceptional report writing skills.

§  Technical teams' fluency in written and spoken English and Somali is a must.

§  Bachelor’s degree in economic statistics, developmental studies, peace and conflict management, or other relevant fields.

§  Master in economic statistics, developmental studies, peace and conflict management, or other relevant fields, will be added advantage.

15. Eligibility Criteria (minimum requirements) imposed on the Tenderer  

The Applicants will initially be verified for eligibility according to the criteria below:

15.1 For individual consultant

§  Official identification document (Passport or National ID)

15.2 For companies

§  Valid tax compliance certificate

§  Valid business registration certificate

15.3 For all consultants (individual and companies)

§  Sample of previous work: At least one of the sample reports need to demonstrate evaluation experience on reconciliation or local governance, also one sample needs to demonstrate evaluation experience in gender and social inclusion.

§  Experience of minimum of 10 years of experience in monitoring and evaluation for the lead consultant, with particular focus on quality tools development, qualitative and quantitative data analysis and exceptional report writing skills.

N.B: Consultants will be first evaluated according to the eligibility criteria and minimum requirements imposed on the procurement as listed in this section 15. Consultants who are eligible and fulfil the minimum requirements will be allowed to proceed to the evaluation phase and their offers will be evaluated according to the contract award criteria (section 16).

Any candidates / bidders / consultancy firms that fail to share the above documentations satisfactorily will be disqualified. Further, shortlisted candidates / bidders / consultancy firms will be subjected to technical interviews to assess their competence regarding the delivery of the consultancy, in line with the consultancy qualifications and bids evaluation criteria listed above.

Deadline for submission of tender bids/offers is on 23rd December 2024 at 5:00 P.M. (East Africa Time Zone). Candidates / bidders / consultancy firms must send their offers via email to [email protected] no later than the deadline as aforementioned. Any tenders received after the deadline will not be considered. Candidates must put “Consultancy to Conduct Project Final Evaluation for MIDEEYE Project” in the subject line of their emails. No tender may be changed or withdrawn after the deadline has passed.

The bidders shall bear all costs associated with the preparation and submission of the offer, and FCA will in no case be responsible or liable for these costs, regardless of the conduct or outcome of the procurement process. Canvassing will lead to automatic disqualification. Please note, only short-listed candidates will be notified for interview. Thank you!

19. Questions

Candidates are not allowed to approach the Contracting Authority for verbal clarification. Any prospective candidate seeking to arrange individual meetings with either the Contracting Authority and/or any other organisation with which the Contracting Authority is associated or linked may be excluded from the tender procedure. Candidates may submit questions in writing via email to the address above latest three days before the deadline.

20. Terms of contract

• Confidentiality – Highlight any confidentiality concern
• (Optional) The Consultant is responsible for payment of all social costs, other employment related costs and insurance contributions and for all other liabilities of a statutory nature.

§  During the assignment, the consultant does not represent FCA Somalia Country Office and has no mandate to negotiate, make commitments or agree on behalf of FCA Somalia Country Office.

§  The consultant is expected to use own computer and other equipment required for works.

• By submitting an offer, the candidate/consultant/service provider confirms to abide by FCA Somalia Country Office Code of Conduct, Child Safeguarding policy and any other relevant FCA Somalia Country Office policies.
• The ownership and copyright(s) of the report(s) and any other produced material will remain with FCA Somalia Country Office.

§  The Contracting authority may for its own convenience and without charge or liability cancel the tender process at any stage.

21. Documents comprising this procurement

Prospective consultancy firms should be able to demonstrate suitability by submitting the following documentations for scrutiny/verification. These include;

§  Technical Proposal including an outline of the proposed methodology, data gathering, etc. As per the terms of reference (maximum 3 pages)

§  Financial Proposal including Indicative budget (maximum 1 page) inclusive of the consultant’s daily rate(s) and other related expenses. Rates should be in US Dollars and inclusive of VAT.

§  Cover letter including a description of suitability of the consultant(s) (maximum 1 page)

§  Valid tax compliance certificate,

§  Valid business registration licence

§  CVs of technical teams, Certifications, Reference Letters

§  At least 3 verifiable proof of experience / sample reports specifically on evaluations on local governance and reconciliation, gender, and social inclusion, among others. At least one of the sample reports need to demonstrate evaluation experience on reconciliation or local governance, also one sample needs to demonstrate evaluation experience in gender and social inclusion.

Annex I – Technical Proposal Template

1.    Rationale (max. 1 page) 

Any comments on the Terms of Reference of importance for the successful execution of activities, in particular its objectives and expected results, thus demonstrating the degree of understanding of the contract. Any comments contradicting the Terms of Reference or falling outside their scope will not form part of the final contract. 

An opinion on the key issues related to the achievement of the contract objectives and expected results 

(Optional: An explanation of the risks and assumptions affecting the execution of the contract) 

2.    Proposed Methodology (max. 3 pages) 

An outline of the approach proposed for contract implementation; 

A list of the proposed activities considered to be necessary to achieve the contract objectives. 

The related inputs and outputs. 

3.    Timetable of activities (max 1 page) 

The timing, sequence and duration of the proposed activities, taking into account mobilization time.