Team leader consultant to conduct project evaluation on investing in early years, Prishtina, Kosovo, Pillar III, 4 months

UNICEF works in some of the world’s toughest places, to reach the world’s most disadvantaged children. To save their lives. To defend their rights. To help them fulfill their potential. 

Across 190 countries and territories, we work for every child, everywhere, every day, to build a better world for everyone. 

And we never give up. 

For every child, support

How can you make a difference? 

Since 2023, UNICEF through the partnership with the Grand Duchy of Luxembourg, has been supporting the Ministry of Health to develop and scale up the Home Visiting (HV) programme within the Primary Health Care (PHC) system. This programme, which connects the PHC and communities (using a set number of home visits from health professionals to pregnant women and young children and their parents), has been fully integrated in the legal framework, including in the Law on Child Protection and in the Administrative Instruction for PHC. The programme is operational in all 38 municipalities, providing more than 16,000 families with support annually.

UNICEF and the Grand Duchy of Luxembourg partnership represents a multi-sector policy package that aligns with the Nurturing Care Framework , which encompasses good health, adequate nutrition, responsive caregiving, and early education, with the main goal of accelerating Early Childhood Development (ECD) outcomes for children, girls and boys, from conception to 5 years of age, through strengthened systems for integrated family-centred, quality services across the health and education sectors. The project was designed under the overall objective to “Accelerate ECD outcomes for children, girls and boys, from conception to 5 years of age, through strengthened systems for integrated family-centred, quality services across the health and education sectors”.

Scope of work

The End of Project Evaluation aims to assess the project’s achievements and progress towards its goals, while also evaluating its relevance, effectiveness, efficiency, and sustainability. While this Evaluation is conducted in the last year of the project implementation and its focus will be summative, the Evaluation is designed to focus on the formative aspect as well to ensure the Evaluation findings will inform future policies and programme interventions.

The Evaluation is commissioned by UNICEF Kosovo Office. In line with the UNICEF’s Evaluation Policy and to ensure independent conduct of the evaluation, the Evaluation will be managed the Child Rights Monitoring Specialist and implemented by international and local consultants. The End of Project Evaluation aims to assess the project’s achievements and progress towards its goals, while also evaluating its relevance, effectiveness, efficiency, and sustainability.

Key objectives include:

1. Assess the project’s relevance, effectiveness, efficiency and sustainability;
2. Provide an independent performance assessment of project achievements as seen in relation to expected results as indicated in the  project monitoring framework;
3. Identify lessons and forward-looking recommendations from the assessment of objectives (1) and (2) above that can inform the future policy developments, decision making and future programme implementation (lessons learned and best practices to be reflected in future programming).

Evaluation Questions

The questions that will guide this evaluation are aligned with the evaluation criteria developed by the OECD Development Assistance Committee (DAC)5 – relevance, effectiveness, efficiency and sustainability. Below a set of key questions is provided and a more targeted sub-questions are to be defined during the inception phase.

Relevance

1. To what extent has the project as a whole aligned with the needs of Kosovo?
2. To what extent were the project objectives and results informed by evidence?
3. To what extent did the project implementation adapt to evolving priorities and where there any unforeseen factors that affected the project’s relevance?

Effectiveness

4. To what extent have the project results been achieved against the objectives and targets set in the project concept?
5. To what extent is data generated through routine data systems and field monitoring, enabling a systematic determination of results achievement and effectives of the programme?
6. Has gender, social and behaviour change and other equity measures (children with disabilities, Roma, Ashkali and Egyptian communities, those living in rural areas and others) been effectively mainstreamed throughout the project implementation and, if not, how could it be done better?

Efficiency

7. To what extent were available financial and human resources used efficiently taking into account cost ffectiveness and operational efficiency of project implementation?

Sustainability

8. To what extent are the achieved results embedded in the system for sustainability after the project ends?

Methodology

The Evaluation will be guided by the “Norms and Standards” and the “Ethical Guidelines for Evaluation” developed by the United Nations Evaluation Group (UNEG)6 and UNICEF’s corporate guidance for human rights-based approach and equity focused evaluations7. It will be planned and implemented with a nonexperimental
design, using mixed-methods and drawing upon secondary data when possible. The team is expected to generate primary data principally through Key Informant Interviews (KIIs) and Focus Group Discussion as relevant, however, use of alternative data generating approaches that add further value is welcome, e.g., administration of online surveys, observation that could be extracted from the existing supported progorammes as part of this project. This data will be used as complementarity and for triangulation with information obtained from the desk review, assessment of progress documents and other information.

Assessment Frameworks and Theories of Change (ToCs)

The implementation of the project has been informed by the Results Framework. While the Results, Monitoring and Evaluation Framework, which includes detailed information on programme results, indicators with
baselines and annual targets, sets the basis for monitoring of implementation of the project, the Evaluation team will be responsible to work on reconstructing the Theory of Change (ToC) to highlight the results chain that will inform the evaluation process. The proposed evaluation methodology should reflect a human rights based and equity-focused approach utilizing disaggregated data by sex, ethnicity, age, disability, etc., and it should pay diligent attention to ethical issues.

Evaluation Process

Once the evaluation team is on board, the Evaluation will be structured in three main phases defined by accompanying activities as described below:

The Inception Phase

• A Desk Review: The evaluation team will commence the Evaluation with a document review for which an electronic library will be established by UNICEF comprising relevant documentation that will be updated on an ongoing basis by both the evaluation team (ET) and UNICEF during the evaluation process. Documentation made available to the team may include but will not be limited to: the project description, including all accompanying documents (monitoring framework, budget etc.), relevant policies and sectoral
  strategies such as the the Kosovo Education Strategy and Action Plan (2017-2021); the Health Strategy (2025-2030); the Kosovo Development Strategy 2030, key relevant policy documentations, situation analysis and other survey relevant reports that include data and information on relevant areas covered by this Evaluation. The desk review should include analysis of all relevant documents that will be used to analysis project’s contribution and achievements as well as other DAC criterias indicated earlier.
• Initial Briefings: In addition to the desk review, brief introductory interviews with staff from UNICEF Kosovo Office will inform the prioritization of evaluation questions and the detailed planning of the evaluation methodology.
• A virtual inception mission (VIM): Once the initial desk review is completed, a 1day virtual inception mission will be organised for the Evaluation Team. One important purpose of the VIM is to introduce the Evaluation and the ET to UNICEF staff and key evaluation stakeholders, including members of an Evaluation Reference Group (ERG) established as a sounding board for the evaluation to foster transparency and participation and to review key evaluation deliverables. This virtual mission will specifically be important to discuss practicalities of the evaluation field mission and any other issues as necessary.
• An Inception Report (IR): An inception report (20 pages) will be submitted that demonstrates impartiality, and that aligns with UNICEF’s quality standards. The IR will be subject to quality assurance performed by the evaluation manager, a review conducted by internal evaluation stakeholders and the ERG, an ethical review – should proposed data gathering involve vulnerable groups,
  sensitive subjects and/or use of confidential data – and, finally, an external quality assurance check that requires to the minimum a satisfactory rating for the field mission to proceed. The approval of the IR marks the completion of the Inception Phase.
• Based on the desk review and VIM, the IR will provide: a contextual description and summary of initial findings available from secondary sources; justifications of proposed changes to the Evaluation ToRs (if relevant); an outline of the detailed methodology (including sampling strategies for all primary data collection); theoretical frameworks against which the project will be assessed; a description of the quality assurance mechanism of the evaluation team. The IR will also outline evaluation team strategies for management of data gaps, or data reliability issues, and it will include ethical considerations relating to primary data generation (if relevant). Attached to the IR will be an evaluation matrix outlining evaluation questions, sub-questions, judgment criteria/indicators, data sources and instruments/methods; a stakeholder analysis; a timeline; the project ToC; and a work plan.

The Data Collection Mission Phase

Following the inception phase, a one-week data collection mission will be organised during which additional secondary data may be identified and primary data will be generated. The primary data will include KII and Focus Group discussion with stakeholders and benefitiaries from relevant groups. 

The Reporting Phase

• The evaluation team will prepare a draft evaluation report, which should include an Executive Summary, that will be subject to a review undertaken by UNICEF Kosovo Office staff, members of the ERG and the evaluation manager; an external quality assurance that requires at a minimum satisfactory rating and, if required, an ethical review.
• Either at the final draft stage (to support the reports validation) or once the evaluation report is finalized (to support further internalization and discussion on the recommendations), the evaluation Team Leader will hold a virtual or in-person meeting with UNICEF Kosovo Office staff, the ERG and, if relevant, other national stakeholders. The report will comply with UNICEF’s reporting standards and be no longer than 40-60 pages excluding executive summary and annexes. Upon completion of the evaluation report, it will be rated in UNICEF’s Global Evaluation and Research Oversight System (GEROS), and it will be published on UNICEF’s global public website. The lessons learned drawn during the process of the design and implementation of the Evaluation will be documented and shared to inform similar evaluation in different contexts.
• Ethical considerations: the evaluation team should clearly identify any potential ethical issues and approaches, as well as the processes for ethical review and oversight of the evaluation process in their proposal with regards to data collection, review and other relevant processes. Management Response (MR)
• UNICEF is responsible for formulating a formal management response also taking into consideration the inputs of the ERG. The MR provides a concrete set of actions that UNICEF commits to undertake in response to evaluation recommendations that are accepted.

Role and Responsibility – Team Leader

The Team Leader has the overall responsibility for the Evaluation. Specific tasks of the Team Leader will include but may not be limited to:

• Guide the extensive desk review of existing information on the context including relevant policies and priorities and all programme documents and reports, previous studies, research and evaluations;
• Develop and provide detailed methodological guidance for the team with regards to the too development and define the overall direction for data analysis and quality assurance;
• Provide guidance in preparation of evaluation deliverables;
• Review all relevant documentation related to the project evaluation;
• Undertake a VIM to verify the scope of the evaluation, the project ToC, stakeholders analysis developed during the desk review, present the evaluation to the UNICEF Kosovo, ERG and, if relevant, other stakeholders and organize the practicalities related to the planning of data collection.
• Lead the data collection mission and decide upon the division of roles and responsibilities with the other member of the team during the entire evaluation process;
• Coordinate the work of the evaluation team and consolidate inputs from the other member of the team to ensure timely delivery of evaluation products;
• Conduct interviews with a range of key stakeholders and informants as per the inception report;
• Lead the planning and conduct of analyses and discussions of evaluation questions and issues common to the other member of the team;
• Lead the consolidation of the other member of the team inputs for the inception and field mission;
• Submit the IR, the draft and final Evaluation reports, and develop and deliver a power point presentation on the main findings and recommendations emerging from the evaluation once the evaluation report has been finally approved;
• Manage the evaluation work plan, respecting deadlines for specific activities and deliverables;
• Maintain a high level of communication with the team members, UNICEF Kosovo staff involved in management of the evaluation and other stakeholders as relevant.

Common tasks and duties for the local team member

• The local consultant will contribute to all stages of the evaluation design and implementation, working under the overall supervision of the team leader.
• The local consultant will be requested to participate in meetings, consultations and discussions of the Evaluation design, methodology, report writing and presentations of relevant documents to the UNICEF staff, ERG or other stakeholders as relevant.

The Evaluation Reference Group (ERG)

The ERG does not have any formal evaluation management responsibilities. It will act in an advisory capacity and provide inputs on all main evaluation deliverables that are expected to strengthen the quality and credibility of the evaluation. The reference group members will be expected to:

• Be a sounding board for feedback during the evaluation;
• Provide feedback on the evaluation approach presented by the Evaluation Team Leader;
• Enable access to key informants during the evaluation process;
• Participate in interviews with evaluators as relevant;
• Review and comment on the IR;
• Participate in the presentation of evaluation preliminary findings;
• Review and discuss the final report, in particular, findings and recommendation

Work Assignments Overview: Conduct desk review and inception report
Deliverables/Outputs: Inception mission and desk review completed
Delivery deadline: 20 April 2025

Work Assignments Overview: Inception mission (online)
Deliverables/Outputs: Inception Mission completed
Delivery deadline: 22 April 2025

Work Assignments Overview: Develop the inception report (maximum 20 pages excluding annexes)
Deliverables/Outputs: Inception report drafted and shared for comments
Delivery deadline: 1 May 2025

Work Assignments Overview: Finalization and approval of Inception Report
Deliverables/Outputs: Inception completed and review/comments from UNICEF and other stakeholders addressed
Delivery deadline: 14 May 2025

Work Assignments Overview: Data collection (KII and Focus Group Discussions)
Deliverables/Outputs: Data collection completed
Delivery deadline: 16 June 2025

Work Assignments Overview: Presentation of preliminary observations and findings to Evaluation Reference Group
Deliverables/Outputs: Preliminary findings presented to UNICEF and Evaluation Reference Group
Delivery deadline: 27 June 2025

Work Assignments Overview: First draft report
Deliverables/Outputs: First draft report developed and shared for review
Delivery deadline: 16 July 2025

Work Assignments Overview: Final Report
Deliverables/Outputs: Final report developed with all comments addressed
Delivery deadline: 1 August 2025

Work Assignments Overview: Final presentations and management response entry points/priority areas discussed
Deliverables/Outputs: Final presentation and discussion on management response completed
Delivery deadline: 15 August 2025

To qualify as an advocate for every child, you will have… 

• Advanced university degree in medicine, public health, education, social science or another related field.
• At least 10 years of previous professional experience in the field of evaluation and evidence generation.
• Demonstrated ability and knowledge to develop rigorous evaluation in line with DAC criteria
• Knowledge of UN programming and previous working experience with UN and/or in international agencies will be an advantage
• Process management skills, including facilitation and communication with stakeholders
• Excellent writing and oral communication skills in English

For every Child, you demonstrate… 

UNICEF’s values of Care, Respect, Integrity, Trust, Accountability, and Sustainability (CRITAS). 

To view our competency framework, please visit here. 

UNICEF is committed to diversity and inclusion within its workforce, and encourages all candidates, irrespective of gender, nationality, religious or ethnic background, and persons with disabilities, to apply to become a part of the organization. To create a more inclusive workplace, UNICEF offers paid parental leave, breastfeeding breaks, and reasonable accommodation for persons with disabilities. UNICEF strongly encourages the use of flexible working arrangements. Click here to learn more about flexible work arrangements, well-being, and benefits.

According to the UN Convention on the Rights of Persons with Disabilities (UNCRPD), persons with disabilities include those who have long-term physical, mental, intellectual, or sensory impairments which, in interaction with various barriers, may hinder their full and effective participation in society on an equal basis with others. In its Disability Inclusion Policy and Strategy 2022-2030, UNICEF has committed to increase the number of employees with disabilities by 2030. At UNICEF, we provide reasonable accommodation for work-related support requirements of candidates and employees with disabilities. Also, UNICEF has launched a Global Accessibility Helpdesk to strengthen physical and digital accessibility. If you are an applicant with a disability who needs digital accessibility support in completing the online application, please submit your request through the accessibility email button on the UNICEF Careers webpage Accessibility jobs-near-me.org UNICEF.

UNICEF does not hire candidates who are married to children (persons under 18). UNICEF has a zero-tolerance policy on conduct that is incompatible with the aims and objectives of the United Nations and UNICEF, including sexual exploitation and abuse, sexual harassment, abuse of authority and discrimination based on gender, nationality, age, race, sexual orientation, religious or ethnic background or disabilities. UNICEF is committed to promote the protection and safeguarding of all children. All selected candidates will, therefore, undergo rigorous reference and background checks, and will be expected to adhere to these standards and principles. Background checks will include the verification of academic credential(s) and employment history. Selected candidates may be required to provide additional information to conduct a background check, and selected candidates with disabilities may be requested to submit supporting documentation in relation to their disability confidentially.

Remarks:  

Only shortlisted candidates will be contacted and advance to the next stage of the selection process. 

Individuals engaged under a consultancy or individual contract will not be considered “staff members” under the Staff Regulations and Rules of the United Nations and UNICEF’s policies and procedures, and will not be entitled to benefits provided therein (such as leave entitlements and medical insurance coverage). Their conditions of service will be governed by their contract and the General Conditions of Contracts for the Services of Consultants and Individual Contractors. Consultants and individual contractors are responsible for determining their tax liabilities and for the payment of any taxes and/or duties, in accordance with local or other applicable laws. 

The selected candidate is solely responsible to ensure that the visa (applicable) and health insurance required to perform the duties of the contract are valid for the entire period of the contract. Selected candidates are subject to confirmation of fully-vaccinated status against SARS-CoV-2 (Covid-19) with a World Health Organization (WHO)-endorsed vaccine, which must be met prior to taking up the assignment. It does not apply to consultants who will work remotely and are not expected to work on or visit UNICEF premises, programme delivery locations or directly interact with communities UNICEF works with, nor to travel to perform functions for UNICEF for the duration of their consultancy contracts.