External Program Evaluator

SUMMARY OF POST RESPONSIBILITIES

The Asia Foundation Philippines Office is seeking a qualified Philippine consultant (individual/group) to serve as an External Program Evaluator forthe Women Environmental Defenders in the Philippines (WE-Defend) Program. The consultant

is expected to implement the roles and responsibilities stated in section 8.

BACKGROUND AND PROGRAM DESCRIPTION

1. Program Information

Title: Women Environmental Defenders in the Philippines (WE-Defend)

Duration: September 13, 2021 – August 31, 2023 (Phase I)

September 1, 2023 – December 31, 2024 (Phase II)

Implementor: The Asia Foundation (TAF) Philippines

Overview

The Women Environmental Defenders in the Philippines (WE-Defend) is a 38-month program that contributes to the meaningful and safe expression, participation, and representation of women environmental defenders (WEDs) in environmental protection and natural resources management across various levels. The specific objectives are to:

Objective 1. Equip WEDs and civil society organizations (CSOs) with the necessary skills to conduct their work safely and effectively and influence policies without threats of violence.

Objective 2. Improve access to justice of WEDs who face violence, abuse, or harassment.

Objective 3. Advance women’s leadership and advocacy on local and national priorities related to natural resources and the environment.

Objective 4. Strengthen public and institutional knowledge of technical environmental information.

The Asia Foundation (TAF) is implementing WE-Defend through partnerships with a consortium of organizations dedicated to addressing the gender and environmental justice nexus, recognized in their respective fields of expertise and grounded in their communities.

2. Scope of the Evaluation

The evaluation will cover program activities, outputs, and outcomes as set out in the WE-Defend Monitoring and Evaluation Plan and submitted quarterly reports. The assessment

will span the entire implementation period of the program to allow a comprehensive understanding of its evolution, achievements, and challenges over time.

The evaluation is anticipated to commence on January 13, 2025, and conclude on February 21, 2025. This timeline is proposed as a guideline, and the external evaluator is expected to work within this period.

3. Purpose of the Evaluation

The evaluation seeks to provide evidence-based insights into the WE-Defend’s contributions, challenges, and impact, with the following key objectives:

• Evaluate the effectiveness of community-based organizing, consortium formation, and capacity-building efforts for environmental justice
• Assess the approaches to which the program partnered and engaged with marginalized communities in the implementation and realization of WE-Defend’s objectives, i.e. in decision-making and facilitation of an enabling environment
• Examine the promotion of a culture of learning and contestation within prevailing dynamics, i.e. amongst communities, consortium members, and management teams

4. Intended User(s) and Use(s)

Primary Users

The primary users of the evaluation findings include The Asia Foundation, partner organizations, and national and local government units in the Philippines.

Secondary Users

Secondary users may include international organizations, research institutions, and other stakeholders interested in evidence-based environmental justice and human rights.

5. Evaluation Questions

Below are the key questions to assist in the assessment:

Effectiveness: How did the program achieve its expected outputs and outcomes based on its objectives and work plan? What were the key challenges along the process?

Equality and Inclusion: How did the program contribute towards localized and community-based environmental and social justice?

• How well has the program addressed cross-cutting themes such as gender equality, social inclusion, and environmental justice?
• What are the key challenges faced during program implementation, and how were they addressed?

Learning Agenda: What should be in place to effectively pursue another WE-Defend program in the future?

6. Principles and Approach that will guide the Evaluation

The evaluation will uphold the principles of independence, transparency, ethical conduct, and cultural sensitivity. The approach will primarily be qualitative, focusing on the significant changes, processes and dynamics, and challenges, with a strong emphasis on sociopolitical and economic positionality, intersectional marginalization, and cultural sensitivity.

Principles

• Uphold the principle of independence, ensuring the evaluation is conducted impartially and without any conflicts of interest. The external evaluator will maintain autonomy in designing, implementing, and reporting on the evaluation.
• Emphasize transparency throughout the evaluation process. All methodologies, data sources, and analytical processes will be documented and shared with stakeholders, promoting accountability and understanding.
• Prioritize inclusivity by actively involving a diverse range of stakeholders, from communities to partners and management teams, in the evaluation process.
• Observe child protection and safeguarding standards, and ethical research principles to minimize harm to evaluation participants, stakeholders, and users.
• Recognize and respect the cultural context of the Philippines, particularly that of the Indigenous Peoples, which comprise not less than 70% of the women environmental defenders engaged in the program. The evaluation approach will be sensitive to local norms, values, and practices to ensure the process is culturally relevant and respectful.
• Integrate a human rights-based and participatory approach into the evaluation, ensuring that the assessment centers the voices of women environmental defenders (WEDs) as the primary assessors of WE-Defend’s contribution/s to environmental and social justice in distributive and procedural arenas, with heavy consideration of the systemic sociopolitical and economic structures in place. The values and processes adhered to during implementation should be examined alongside this impact and political economy investigation.
• Foster a culture of learning within the evaluation process itself. Regular feedback loops, adaptive management principles, and continuous improvement will be employed to enhance the relevance and effectiveness of the evaluation.
• Apply data privacy protections consistent with The Asia Foundation’s policy on confidentiality, minimization, integrity, and protection.

Approaches

• Primacy and centrality of the voice of WEDs as primary assessors of WE-Defend’s contribution to environmental and social justice.
• Adopt a utilization-focused evaluation approach, prioritizing the needs of intended users. The evaluation design and methodologies will be crafted to generate actionable insights for decision-makers, program implementers, and stakeholders.
• Apply outcome harvesting techniques to identify and understand unexpected and unintended outcomes of the program. This method complements traditional evaluation approaches, capturing the complexity and nuances of program impacts.
• Validate the program’s Theory of Change to ensure that the evaluation is aligned with the program’s intended outcomes and assumptions. This process will involve engaging with key stakeholders to validate the logic behind the program’s theory.

7. Methodology

The evaluation will utilize a qualitative approach, including:

1. Document Review: Conduct an extensive review of program documents, including proposals, progress reports, and relevant publications, to assess program design, implementation, and outcomes.
2. Key Informant Interviews: Conduct structured interviews with key stakeholders, including program staff (TAF and partner organizations), partners (local and national), and women environmental defenders and their communities. The interviews will explore perceptions of program relevance, effectiveness, and impact.
3. Other data-gathering methods necessary to engage with stakeholders, and validate information obtained through other data-collection methods.

Data Analysis

Qualitative Analysis: Employ thematic analysis to identify recurring themes and patterns in qualitative data obtained.

Triangulation and Validation

Implement a triangulation approach by cross-referencing findings from multiple data sources

(documents, interviews) to enhance the reliability and validity of the evaluation results. Inconsistencies and convergences across data sources will be explored to ensure a comprehensive understanding. Conduct validation sessions with key stakeholders to present and discuss preliminary findings. Feedback obtained during these sessions will be integrated into the final analysis to enhance the validity and relevance of the evaluation.

Management

The selected evaluator is also expected to organize and collaborate with the Philippine program team to ensure a nuanced understanding of the local context, awareness of cultural sensitivities, and the radical approaches employed in WE-Defend. This engagement is integral to enhancing the relevance and effectiveness of the evaluation process. The external evaluator will coordinate the logistics for document review, interviews, and other data-gathering methods with TAF.

8. Roles and Responsibilities

The External Evaluator will:

• Design the evaluation framework following WE-Defend principles and values.
• Establish effective communication channels and regular check-ins with the Philippines program team to address queries and issues.
• Conduct the data collection, analysis, and reporting process.
• Ensure the independence and impartiality of the evaluation.

The Philippines Program Team will:

• Facilitate access to program sites, documentation, and key stakeholders.
• Collaborate closely with the external evaluator throughout the evaluation process.
• Provide necessary information and insights to enhance the evaluation’s depth and accuracy

The Key Stakeholders will:

• Actively participate in interviews, focus group discussions, and validation sessions
• Offer diverse perspectives to enrich the evaluation process.
• Provide feedback on the preliminary and final findings to enhance the evaluation’s credibility.

9. Evaluator Qualifications

The External Evaluator should possess:

• Expertise in program evaluation, with a track record of evaluating programs with similar objectives, with comprehensive knowledge in participatory methodologies in women-led and gender-diverse, community-based initiatives.
• In-depth knowledge of the political economy of environmental and social injustices in local communities and marginalized sectors, focusing on the structural conditions perpetuating these.
• Experience in applying outcome harvesting techniques to capture expected and unexpected program outcomes.
• Demonstrated ability to actively involve diverse stakeholders in the evaluation process, particularly communities and their leaders, local implementors (NGOs), and national-level organizations.
• Experience applying a gender and social inclusion lens in evaluation, ensuring that the assessment captures differential impacts across diverse groups.
• Commitment to ethical conduct, including prioritizing informed consent, safeguarding confidentiality, and respecting participants’ rights.
• Familiarity with and adherence to international evaluation standards, ensuring the evaluation aligns with best practices in the field
• Excellent written and verbal communication skills, with the ability to present complex findings in a clear and accessible manner.
• Degree in community development, human rights, environmental policy, anthropology, sociology, or law or similar relevant degree or educational background.

10. Reporting Requirements

The External Evaluator will:

1. Week 1: Submit initial evaluation package, including:
   • Evaluation plan
   • Timeline and schedule
   • Methodology
   • Preliminary desk review
2. Week 3: Submit a comprehensive draft report, including:
   • Revised version of previously submitted sections
   • Findings and analysis
3. Week 5: Submit a finalized report incorporating feedback, providing a thorough and transparent account of the evaluation findings and recommendations
   • Revised version of the previously submitted sections
   • Executive summary
   • Recommendations
   • Lessons learned
   • Appendices

11. Estimation of the Cost and TAF Application Policy

The estimated cost for the evaluation should cover personnel, travel, accommodation, and other associated expenses.

The Asia Foundation is an equal opportunity employer, with personal and professional development opportunities provided to all staff. The Foundation adheres to a strict code of ethics and has zero tolerance for sexual harassment and exploitation.

How to apply

For more details on these opportunities, access the Terms of Reference here: https://tinyurl.com/TAFPHConsultancyOpportunities

APPLICATION GUIDELINES: Individual Applicants must complete and send in their The Asia Foundation Application Form, Employee Biographical Data Form (https://tinyurl.com/TAFApplicationReqs), and sample portfolio (optional).

Applicants may send in the requested documents to consultancyPH@asiafoundation.org before the set deadline.