Terms of Reference – Consultancy to conduct a midterm evaluation for the Somalia Program

Background

American Friends Service Committee is a Quaker organization that includes people of various faiths who are committed to social justice, peace, and humanitarian service. Guided by the Quaker belief in the divine light of each person, AFSC works with communities and partners worldwide to challenge unjust systems and promote lasting peace. AFSC has more than 100 years of experience building peace in communities worldwide and works in the following ways: bridging and convening, community organizing and civil society strengthening, advocacy, research, and analysis. It seeks to change situations and systems that lead to violence. Much of AFSC’s work includes support for dialogue and capacity-building opportunities led by the affected communities.

About the Program

AFSC is implementing a youth empowerment program aimed at promoting youth engagement in peacebuilding and protection of migrant rights in Mogadishu and Bossaso by working directly with two local partners in Mogadishu and Bossaso for two years. The program aims to support youths in implementing peace initiatives while enabling them to lead in social cohesion and engaging the female youth to take a leading role in peacebuilding initiatives. Further, the program aims to create awareness of the rights, and obligations of migrants and ensure that they can demand these rights and access essential services. A series of activities have been implemented to ensure the success of the program.

Scope: The evaluation will cover the period from October 2023 to December 2024, to create an accurate and comprehensive picture of the project implementation, generating findings on evaluation criteria and documenting good practices and lessons learned.

Program locations: Mogadishu and Bossaso, Somalia

Evaluation Objective:

The overall objective of the mid-term evaluation is to assess the achievement of the project objective against indicators.

Objective 1: Youth engagement in peacebuilding is enhanced.

Indicators:

• Out of 800(300F) addressed by project interventions, at least 75% (600) develop and implement at least 12 local peace initiatives.
• Out of 800 (300F) reached through peacebuilding interventions, 60% (480) are leading social cohesion initiatives.
• At least 50% (150) of the target 300 female youth trained in peacebuilding are taking a leading role in peacebuilding initiatives in the community

Objective 2: The protection of migrant rights is improved.

Indicators:

• At least 50% (300) of 600 (300F) migrants reported that they are aware of their rights, obligations and demand for their rights.
• Out of 600 (300F) migrants reached by the project interventions, at least 50% are accessing services. (Education, medical, legal aid, clean water, shelter and job opportunities)

The mid-term evaluation will specifically:

a) Assess Program relevance, performance, effectiveness, efficiency, impact, and sustainability.

b) Qualitatively and quantitively, capture the key lessons and progress towards achieving the indicator by assessing the categories below:

• Somali youth and women reached through peacebuilding efforts, community healing, civic engagement, humanitarian support, and migration awareness among others.
• Civil Society Organizations (CSOs) participating in advocacy for migrants’ rights.
• Implementing partners and their staff.
• Other stakeholders such as local government administration, religious leaders, clan elders, and women groups.

c) Highlight key stories of change, best practices, challenges, and recommendations for the remaining implementation period and future projects.

AFSC encourages evaluators to develop Key Evaluation Questions based on the Quality Standards of the Development Assistance Committee (DAC) of the Organization of Economic Co-Operation and Development (OECD), emphasizing Relevance, Coherence, Effectiveness, Efficiency, Impact and Sustainability.

Key Evaluation Questions based on DAC Criteria.

a) Are the implemented activities relevant, appropriate, effective, and implemented efficiently?

b) What are the key program outputs and outcomes and how are the program activities contributing to the outcomes?

c) What capacity-building activities have been undertaken to strengthen implementing partners and how did they contribute to achieving the program goal?

d) To what extent is the program leading to improvement in youth engagement in peacebuilding and protection of migrant rights?

e) How were the different clusters of youths (women, IDPs, refugees, host communities, and vulnerable groups) involved in the program?

f) What are the factors contributing to the achievement or non-achievement of the program objective?

Impact:

a) What real difference has the program brought about for the participants? What would have happened without the activity?

b) How many people have been affected since the program started to date? Planned target group vis-vis really addressed?

c) What are the short and medium-term (intended and unintended) outcomes of the program?

d) To what extent were the selected target groups reached?

Sustainability of the program:

a) To what extent will the positive impacts or changes of the program (are likely to) continue?

b) Which measures are implemented to support continuity?

c) What are the major factors influencing the achievement or non-achievement of sustainability of the program?

d) To what extent is the exit strategy relevant?

Evaluation Methodology, process, and reporting

The evaluation will involve participatory methodologies and tools. The evaluator will creatively employ a mix of techniques for data collection and will among others hold meetings and discussions with Somali youth/program participants, key informants, interviews with the implementing partners and AFSC staff. AFSC will make accessible program documents for review and secondary data collection.

The consultant is expected to:

1. Provide Inception report: A concise inception report, including the proposed approach, design, and methodologies for the study.
2. Present a detailed work plan upon contract signing
3. Present data collection tools to be discussed and agreed upon with AFSC.
4. Draft midterm report in English: A maximum of 40 pages (Calibri 12), excluding annexes, case studies, and executive summary. We encourage the inclusion of innovative communication products to convey the key evaluation findings to the target groups.
5. Present and validate findings: The consultant is expected to present the draft midterm report to AFSC, implementing partners, and relevant stakeholders for validation and target-setting objectives.
6. Present the final report with similar requirements as a draft evaluation report and free of plagiarism.

Consultancy period

The consultancy is expected to run from 1st February to 28th February 2025. The final report should be submitted by 28th February 2025.

Applicant Requirements

Qualifications of the Consultant

AFSC is seeking a qualified, experienced, proactive, and dedicated expert with knowledge in conducting evaluations.

Required skills and experience:

1. The consultant should hold at least Masters-level training in project management, monitoring and evaluation, social sciences, applied statistics, or any other relevant field.
2. Minimum eight years of relevant experience in conducting research and evaluations for development programs in Somalia context.
3. Excellent understanding of peacebuilding and migrant rights issues.
4. Proven track record in quantitative and qualitative methods, data analysis, and participatory approaches.
5. Strong interpersonal skills and ability to work with people from different backgrounds to deliver quality products within a short time frame.
6. Experiences and/or know-how of project implementation at the community level.
7. Be flexible, responsive to changes and demands, and open to feedback.
8. Excellent writing and oral communication skills in English.

How to apply

All interested applicants who meet the required qualifications and experience are invited to submit their application including:

• Cover letter and CV.
• Technical proposal that summarizes understanding of TORs and methodology.
• Financial proposal indicating consultancy fee with a breakdown of costs.
• Three referees (one being on the most recent assignment).

Applications should reach AFSC on or before 5:00 PM on 14th January 2025 and be sent to:

The Sub Region Representative – Somalia and South Sudan

P.O. Box 66448 – 00800

Nairobi, Kenya

On email: infoafrica@afsc.org

The AFSC is an Affirmative Action/Equal Opportunity Employer.