Call for consultancy – End of project Evaluation of the Inclusive Markets for Energy Efficiency in Uganda (IMEU) Project.

Company Description

SNV is a mission-driven global development partner, rooted in the contexts and societies where we work. Inspired by the transformational principles and objectives set out by the SDGs, we are committed to building resilient agri-food systems that deliver food security and adequate nutrition; to increasing the reliability and availability of water and sanitation at an acceptable quantity and quality; and to improving access to affordable and sustainable energy for all. In doing so, we aim to strengthen institutions, markets and effective governance within and across the agri-food, energy, and water sectors, reducing gender inequalities and barriers to social inclusion, and enabling adaptation and mitigation to the climate and biodiversity crises.

We are one team of over 1,600 people, the vast majority of whom come from the contexts where we work, in more than 20 countries in Africa and Asia. In Uganda SNV operates through a decentralised approach with a country office in Kampala and regional offices in Fort Portal, Lira, Jinja, Kabale and Mbarara. SNV implements donor-funded activities across more than 100 districts in Uganda, ensuring broad and diverse impact.

Our ability to deliver results rests on our robust foundation of experience, knowledge, evidence and learning; our commitment to strengthening capacities and catalysing partnerships; and the relationships and trust of those we work alongside. Our core values of people-centeredness and respect, equity and equality, and diversity and inclusion, are fundamental to who we are, and what we do. This is reflected in our vision and mission, and strategy, which sets out our aspirations and commitments as our compass towards 2030. For more information on our operations in Uganda and SNV visit our website: www.snv.org

Background to The Inclusive Markets for Energy Efficiency in Uganda (IMEU) project

The Inclusive Markets for Energy Efficiency in Uganda (IMEU) is a four-year project funded by the Embassy of Sweden (EoS) in Kampala, Uganda. IMEU is implemented by a consortium of 3 partners: SNV (lead), Makerere University, College of Engineering, Design, Art, and Technology (CEDAT), and Private Sector Foundation Uganda (PSFU).

The project deploys an Energy Efficient (EE) market development approach intervening at demand, supply and enabling environment for EE market as follows:

(1) Stimulating uptake of EE products and services by increasing awareness among energy users (Demand side)

(2) Targeted and contextualized derisking support to small medium enterprises (SMEs) and energy service companies (ESCOs) and Energy Service Provider Companies (ESPC) (Supply side).

(3) Strengthening institutional coordination, research and enabling environment for energy efficiency (Enabling environment).

The thematic scope of the project is agriculture (focus on agribusinesses and farmers cooperatives) and built environment (focus on households, businesses, and institutions). The project results framework and TOC is described here.

Rationale and Purpose of the Evaluation

Following its nearly three and a half years of inception and implementation (November 2021 – April 2025), IMEU will be phasing out its activities by June 2025, the five months following from July 2025 to Nov 2025 have been reserved for reporting and final closure of project. The project is now commissioning an evaluation to verify the project’s impacts/outcomes and derive the key lessons learned. A focused set of OECD/DAC criteria shall be used as the guidelines for the project final evaluation to look at the project’s relevance, efficiency, effectiveness, coherence, impact, and potential for sustainable scalability. Lessons learnt from the project will inform project partners and the donor EoS on how to integrate IMEU learnings into other ongoing or planned programs. The primary audience of this evaluation will be IMEU project consortium partners, the EoS, MEMD, as well as other relevant development partners and programs.

The project is therefore seeking an external team of evaluators or a firm to undertake the end of project evaluation to ensure an objective assessment of the project performance. Ideally, the consultancy team should demonstrate a proven track record of evaluating similar projects.

The end of project evaluation aims to achieve the following objectives:

• Objective 1: Assess the project’s relevance to the needs and priorities of the project’s target groups and grantees, efficiency and effectiveness in achieving project outcomes, coherence with other relevant initiatives, intended and unintended impact of the project, and potential for sustainable scalability.
• Objective 2: Draw lessons, best practices, and recommendations to inform potential future programming, local partners, and other project stakeholders.

The evaluation will utilize the Baseline, annual reports, and other relevant project documents as secondary data

Scope of the evaluation.

The project interventions are in agriculture and built environment. In agriculture, the project intervenes four value chains (Maize, Tea, Sunflower and soybean), specifically processors in the said value chains. In the built environment, the project targets businesses e.g. hotels, restaurants, and social institutions like schools, and hospitals. Over the project life, the project targets 328 businesses, 52 social institutions, 13 Energy service provider companies and 30,000 households using EE technologies and services. A detailed project results framework and TOC is described here.

In terms of geographical scope, the project intervenes in three regions i.e. Western, Northern and central. In the western region, it covers Fort Portal Tourism City, Kabarole, Kanungu, Buhweju and Bushenyi districts. In Central, the project covers Kampala metropolitan (Kampala Capital City, Mukono and Wakiso) and in the North covers Lira City, Dokolo, Oyam, Dokolo, Kole and Lira Districts.

Evaluation questions

The final evaluation questions are framed based on the OECD evaluation criteria to address object 1 above. The consultant is expected to demonstrate how the evaluation criteria and questions support learning through generating and feeding back findings and lessons learned. Below are the proposed evaluation questions, which can be reviewed/adjusted by the consultant(s) in the proposal. At the inception phase, the evaluation sub questions will be refined and agreed upon by both the consultant and the client (SNV)

1. Relevance: To what extent did the project’s objectives, TOC and intervention strategies address the needs and priorities of the project’s primary target group (Businesses, Social institutions and Households)?
2. Coherence: To what extent was the project internally and externally coherent? For example, internally coherent with other SNV projects/interventions in energy, agri-food and water? Externally coherent with other actors’ interventions in the energy sector, looking at complementarity, coordination and possible duplication?
3. Effectiveness: To what extent has the intervention achieved, or is expected to achieve, its objectives, and its results, including any differential results across groups? How effective have the project strategies and approaches been in achieving the expected results?

Relevance – “The extent to which the objectives of a development intervention are consistent with beneficiaries’ requirement, country needs, global priorities and partners’ and donors’ policies”.

Coherence – “The compatibility of the intervention with other interventions in a country, sector or institution”

Effectiveness – “The extent to which the development intervention’s objectives were achieved, or are expected to be achieved, taking into account their relative importance”.

Sub-questions:

1. Which elements of the project strategies and approaches were more effective in contributing to the (unexpected) positive changes, and which less? Which strategies and approaches contributed to (unintended) negative changes? What could have worked better and how?
2. Which elements of the project strategies and approaches are most successful and appropriate to be scaled up, and why?
3. What key internal and external factors facilitated or hindered the project’s achievements compared to the expected targets?

4. Efficiency: To what extent did the intervention deliver, or is likely to deliver, results in an economic and timely way?

Sub-questions:

1. Did the project convert inputs (funds, expertise, linkages, time, etc.) into outputs, outcomes and impacts in the most cost-effective way possible, as compared to feasible alternatives in the context
2. Are the project budgets aligned with project activities taking into account adaptive management? What kind of adjustments or changes did management make to ensure achievement of targeted activities
3. Was the project implemented within the agreed project timeframe considering factor outside the project’s control?

5. Impact: To what extent has the intervention generated or is expected to generate significant positive or negative, intended or unintended, higher-level effects?

Sub-questions:

1. What are the key positive and negative (unexpected) changes experienced by the project target groups, and to what extent are these linked to the project interventions?
2. What are the social, environmental and economic effects of the intervention in the long-term and for the communities as a whole?
3. What are the indirect, secondary and potential consequences of the intervention?

6. Sustainability: How sustainable are the project results and achievements in the medium term?

Sub-questions:

1. To what extent will the project’s results and achievements sustain after the intervention has ended? What is the potential for further sustainable scale up?
2. Which project internal and external factors (might) affect (positively or negatively) the sustainability of the project achievements? What are the potential risks and trade-offs with adopting farmers?
3. How is the changing context on the targeted sectors especially in the tea value chain likely to affect the sustainability of the project interventions and/or impact?

The following strategies will be reviewed: Market Development Fund, Multi-stakeholder Platform, Applied Research, Capacity Building, Gender, Equality and youth involvement, and behaviour change communication.

Efficiency- “The extent to which the intervention delivers, or is likely to deliver, results in an economic and timely way”

Impact- “The extent to which the intervention has generated or is expected to generate significant positive or negative, intended or unintended, higher-level effects.”

Sustainability – “The continuation of benefits from a development intervention after major development assistance has been completed. Probability of long-term benefits. The resilience to risk of the net benefit flows over time

To meet objective 2 above, the evaluation shall answer the questions,

What lessons, and best practices can be drawn, and recommendation made to improve the future design and implementation of related or similar projects?

Sub questions: the evaluation will answer the following sub-questions

Lessons learned:

1. What key lessons have emerged that could help improve future project design and implementation?
2. How could these lessons be applied to enhance the impact and efficiency of similar projects?

Best Practices:

1. Which practices fostered strong collaboration among local partners and stakeholders?
2. How can these collaboration practices be sustained or improved in future projects?
3. Which best practices have proven successful and could be scaled or replicated in similar contexts?
4. What adjustments might be necessary to make these practices applicable in other regions or with other stakeholders?

Recommendations

1. How could the lessons and best practices identified contribute to the long-term sustainability of similar projects?
2. What strategies are recommended to ensure continuous improvement in future programming?

The consultancy team is expected to design and facilitate a final reflection workshop to disseminate, triangulate and reflect on the evaluation findings among all the main stakeholders.

EVALUATION APPROACH AND METHODS

The final project evaluation will adopt a mixed-methods approach, integrating both qualitative and quantitative data collected from primary and secondary source.

• Primary data collection will prioritize participatory and inclusive processes, ensuring engagement with diverse stakeholders. This will encompass a cross-section of key actors, including Households, youth, female and male headed, grantees, policymakers, Development partners, LGs, Academia, Financial institutions, Agro-industries, businesses, social institutions and government MDAs
• A carefully developed sampling strategy will guarantee representation from varied stakeholders, with particular attention to ensuring adequate inclusion of women and youth perspectives. Data collection and analysis will adhere to a gender and age-disaggregated framework, with additional segmentation by location where applicable.
• In-depth analysis will be conducted on at least six participants in the RBF, evaluating their business models, inclusivity (including linkages with cooperatives and farmers), and future viability.
• Secondary data will be drawn from comprehensive desk studies encompassing relevant project documents such as reports, monitoring and supervision reports, baseline data, IMEU impact stories and case studies, national datasets and relevant external reports where applicable.

Job Description

Expected Deliverables

• Final approved inception report detailing the methodology, timelines and workplan, clear sampling framework and data collection and analysis plan.
• Copies of pre-tested evaluation tools developed by the consultant
• Recruitment, training, and supervision of data enumerators
• Draft end of project evaluation report
• Stakeholder validation workshop and meeting report for the study
• Complete cleaned datasets (both qualitative and quantitative)
• Final report with project indicators values, infographics summary of findings and PowerPoint presentation.
• Develop an abridged version (No more than 5 pages) of the evaluation report that can be used for external dissemination

Roles and responsibilities

The consultant is expected to abide to the following:

• Assignment Execution: Undertake the assignment as outlined in the ToR and complete the tasks within the allocated time.
• Communication and Liaison: Update project stakeholders regularly on progress and liaise with the IMEU team for information sharing and meetings with other stakeholders.
• Logistics: Arrange their own means of transport and accommodation. This includes coordinating travel to and from field sites, securing appropriate lodging, and ensuring that all logistical arrangements support the efficient and effective execution of the evaluation activities.
• Data and Reporting: Hand over all datasets as part of the deliverables as all data collected and reports delivered under this assignment are property of IMEU. Ensure strict data protection measures are in place, including secure storage, handling, and transfer of all collected data, in compliance with applicable data protection laws and guidelines.
• Code of Conduct: Sign and observe the SNV Code of Conduct/Safeguarding policy during the evaluation process. The consultant(s) must adhere to high standards of ethical behaviour, including honesty, integrity, and respect for all participants. They should avoid any conflicts of interest, maintain professional boundaries, and ensure that all interactions are conducted in a fair and impartial manner.
• Confidentiality: Guarantee the confidentiality and anonymity of participants in the evaluation process.
• Cost Management: Handle all costs associated with the evaluation process.

The roles and responsibilities of IMEU shall include.

• Evaluation Oversight: Assess the evaluation bids, validate the proposed evaluation design, and provide necessary advice. Manage contractual oversight.
• Information: Ensure the evaluation team has access to all necessary information, including project documents.
• Access and Support: Facilitate the smooth realization of the evaluation by providing logistical advice, including recommendations on suitable accommodations or locations for training field teams. Assist with the mobilization of selected respondents and ensure local support during field missions. Facilitate liaison with key stakeholders, including implementing grantees, local governments, and MDAs. Organize the validation workshop(s) as specified in the timeline.
• Feedback and Reporting: Discuss and comment on reports delivered by the consultant(s) at each stage, and assist in providing feedback on the findings, conclusions, and recommendations.

Qualifications

Required Qualifications, competencies, and experience

Team composition, qualifications, and experience

The team should be a multidisciplinary team with diverse expertise and experiences in the EE subsector, data analytics, market assessments, business development, gender-responsive programming and knowledge management.

The required person(s) should possess the following qualifications:

Team Leader: Advanced degree with at least 10 years’ experience in Business Management, Engineering, Statistics, Marketing, Agribusiness, or agricultural economics. At least possess a post-graduate training in Monitoring and Evaluation. S/he MUST have demonstrated skills and experience in undertaking qualitative and quantitative research methodologies as well as participatory research. In addition, the team leader should demonstrate international and national experiences in undertaking similar assignments.

Renewable Energy and Energy Efficiency Expert: Advanced degree with at least 5 years’ experience in renewable energy and energy efficiency project implementation. S/he should demonstrate an understanding of the Energy sector and energy efficiency subsector in Uganda and knowledge and skills of energy management in the agriculture and built environment sectors.

Monitoring, Evaluation and Learning Expert: Degree in project planning, monitoring and evaluation or equivalent. Demonstrated experience of at least 5 years in undertaking baselines, midline, and end line studies of project with excellent data analysis skills.

Financial/investment specialists: Advanced degree in business management, finance, and Investments with at least 5 years’ experience. Demonstrated experience in business development and investment appraisals. 

Gender specialist: Degree in Gender studies or any related field with demonstrated experience in undertaking gender surveys and developing gender action plans. S/he should possess experience of at least 5 years’ experience in gender analysis studies.

Team competencies

In addition to the above expertise and experience, the proposed team should demonstrate the following competencies.

• Strong research and analytical skills
• Demonstrated oral and written communication skills
• Demonstrated stakeholder engagement and facilitatory skills
• Evidenced qualitative and quantitative data collection and analysis skills
• Good understanding of operations of a market systems development approach
• Ability to undertake studies in challenging environments
• Must be digital and technological savvy

Additional Information

Reporting and Supervision.

The consultant shall be directly supervised by the Project Manager, IMEU and supported by the Monitoring, Evaluation and learning Advisor for quality assurance of the evaluation study. The MEL advisor shall be assigned for the day-to-day support to the consultant and updates of the assignment.

Requisite documentation for the consultant

• Company Legal registration documents (Articles of Association and Powers of Attorney)
• Tax Compliance Certificate
• Valid trading license
• Company profile
• CVs of all the proposed staff for the assignment
• List of References (with valid contacts) for earlier similar tasks undertaken

Schedule and timelines

The review will be conducted within 3 months (approx. 55 working days from signing of contract) broken down as follows:

1. Opening Tender, proposal review and selection of the consultant (15th Dec to 6th Jan 2025). This stage entails preparatory activities for the evaluation that are undertaken by the contracting agency in this case SNV. The activities of this phase include drafting of the ToR, Approval and publication of the ToR, selection and contracting of successful consultant.
2. Inception Phase (7th to 21st January 2025) (14 days) – The inception phase will result in an inception report. The inception report should clearly outline the evaluation design, operationalize the evaluation questions and indicators to be used, further detail the data collection methods as well as propose a detailed time schedule. The inception report is subject of formal approval by the project PM.
3. Execution Phase (22nd January to 16th February 2025) (25 days) – This phase entails the execution of the evaluation plan as detailed in the Inception report. Desk research and fieldwork will provide in-depth insight in the activities of IMEU, as well as on the results achieved. Fieldwork will be carried out following the evaluation plan as presented in the inception report. In this phase the consultant will also be expected to conduct data analysis, interpretation and compile a draft evaluation report (in MS Word) including findings, conclusions and recommendations presented to the IMEU. We expect the team to follow the agreed upon timelines. Any significant change to the timeline needs approval of IMEU project manager.
4. Closure Phase (16th February to 2nd March) (15 days)– The key deliverable for this phase includes the final approved evaluation report. Other deliverables include participation in discussion of findings with IMEU team and other stakeholders (validation workshop), a PowerPoint with preliminary findings, a detailed final evaluation report considering all comments received from project stakeholders and complete and cleaned datasets.

Contracting and Proposed payment terms

The assignment is expected to be undertaken within 50 days. The contract shall be a fixed term with all the key activities and deliverables paid based on the value for money offering agreed during negotiation. The proposed payment terms are based on specific quality approved deliverables.

• 40% based on an approved inception report and study tools
• 40% based on an approved draft end of project evaluation report
• 20% based on an approved Final end of project evaluation report, PowerPoint presentation and infographics.

Evaluation Criteria

The procurement evaluation committee shall duly evaluate all technical and financial proposals as per submission deadline for the bids. This shall follow the overarching criteria below.

Aspect

1. Administrative

Compliance with legal registration and tax requirements

Weighting score – Pass/Fail

2. Technical

The technical assessment is based on understanding of TOR (20), Experience in conducting similar assignments and team competencies (20), Detailed and realistic workplan (10), Technical appropriateness and feasibility of the proposed methodology including detailed sampling procedures (30)

Weighting score – 80%

3. Financial

This is a cost-based assessment with a value for money focus

Weighting score – 20%

How to Apply

Application process.

Questions regarding the evaluation.

Interested parties are encouraged to submit their question via imeu@snv.org by the 25th of November 2024 and the answers will be shared with all parties by the 27th of November 2024.

Submission of proposals

Interested companies should send technical and financial proposals to SNV Netherlands Development Organization in soft copies via email: ugandatenders@snv.org. The subject should read: End of Project evaluation for IMEU project. The technical proposals should include CVs of the key personnel as well as list of similar tasks accomplished before.

Deadline for submissions

All the applications should be sent not later than 13th December 2024 at 5:00 pm. Any applications past the deadline shall not be received. Only successful applications shall be contacted.

Working at SNV: We offer a challenging work environment, opportunities to lead and innovate, and a commitment to growing your skills in a fulfilling and diverse working environment. Our staff benefit from and contribute to an international global network of experts. For more information, please visit our website: www.snv.org.

NB: only shortlisted candidates will be contacted.

Disclaimer.

SNV reserves the right to accept or reject any or all applications submitted. SNV can stop this procurement at any time without the need to explain or extend the deadline for submission once it sees fit. In case you do not hear from SNV within three weeks of the closure of the application process, consider yourself unsuccessful. SNV also reserves the right to reject and cancel this call-in in case any illegal, corrupt, coercive, or collusive practices are noticed. Late applications will be rejected. Please note that viewing, downloading or otherwise using the TOR constitutes acceptance on your part of all the above-noted statements and conditions.

We do not appreciate third-party mediation based on this advertisement.

Read Full Description