Terms of Reference
Independent External Evaluation
|
Project Title
|
: Strengthening Village Capacity in Tourism Development Based on Local Natural
and Cultural Resources (Memperkuat Desa Dalam Mengembangkan Pariwisata Berbasis
Sumberdaya Alam dan Budaya Setempat)
|
|
Funder
|
: William & Lily Foundation
|
|
Project Period
|
: December 2018 – December 2020
|
|
Evaluation Period
|
: October 2020 – January 2021
|
Introduction &Rationale for Evaluation
The William & Lily Foundation(WLF) is an Indonesian-based philanthropic
foundation established in 2009 as anoutgrowth of the philanthropic legacy of
William and Lily Soeryadjaya. As anactive grant-making foundation, WLF works
closely with implementation partnerson four focus areas: education, health
care, economic empowerment and enablingenvironment. WLF is committed to
impactful and responsible interventions in itsefforts to empower
underprivileged communities across Indonesia. Although thescope of WLF
philanthropic endeavours is countrywide, its current geographicalfocus centres
on eastern Indonesia, particularly on the island of Sumba.
In December 2018, WLF formed apartnership with the Institute of Research and
Empowerment (IRE), inimplementing a two-year program entitled Strengthening
Village Capacity inTourism Development Based on Local Natural and Cultural
Resources in SumbaBarat Daya. This project is called DesaWisata. The project
aims to develop village-based tourism in two pilotcommunities by achieving the
following outcomes: 1) improving local governmentpolicies and programs to
support village tourism development; 2) improvingvillage governance to better
facilitate village-based tourism; 3) improvingpartnership between local
government and villages; and 4) improving skills andcapacity of the communities
to develop and manage village-based tourism. Desa Wisata project’s approaches
includepolicy advocacy at district level, strengthening communication forum
fortourism actors, village assistance to improve village governance in
supportingtourism villages and strengthening the capacity of local organization
and BUM Desa in managing tourism village. Project’sbeneficiaries are the local
organization, BUMDesa, and communities in the respective village. The project
alsocollaborates intensively with key stakeholders, such as village
government,civil society organizations and government institutions at district
level (i.e.Tourism office, Village Community Empowerment Office and Development
PlanningAgency at Sub-National Level).
As this project is nearing completion,WLF plans to conduct a comprehensive
final evaluation that will provide a 360degree outlook on –not only project
results towards its intended outcomes, butwill also evaluate the effectiveness
of the management and implementationprocess of the project, the appropriateness
of chosen interventions, aswell as to observe whether this project has applied
the value for moneyprincipal. As perWLF’s policy, this project is subject to
external independent evaluation. WLFis therefore seeking individual or a team
of evaluators to conduct thisevaluation.
Purpose, Scope andUsers of Evaluation
The objective of this independentevaluation is to provide a comprehensive
evaluation on the project managementand implementation process performed by the
implementing partner, in this casethe Institute for Research and Empowerment
(IRE); particularly on how theproject was able to meet the agreed upon project
objectives, outcomes andoutputs, as well as to evaluate whether the project has
been carried out in acost-efficient manner. This evaluation is also aimed at
observing thechallenges faced and document lessons learned and best
practicesproduced. Furthermore, this evaluation also aims to understand
theefficiency and effectiveness of the grants and technical support WLF
providedto the implementing partner during the lifetime of the project.
The evaluation will cover the project'svarious components (such as the expected
outcomes, outputs and activities) asreflected in the project document as well
as subsequent modification andalterations made during its implementation. The
main user of findings andrecommendations from this evaluation will be the
William and Lily Foundation. Other potential users may include but notlimited
to the Foundation’s implementing partners and relevant stakeholders asnecessary.
Methodology
The evaluation will be based on a participatoryapproach, involving a wide range
of selected key Stakeholders. The evaluationwill use both primary and secondary
data sources for probing the progress andfor generating evidence in support of
the findings. Overall, the evaluationapproach should refer to OECD-DAC criteria
(OECD-DAC recommendstandard for evaluation criteria, such as relevance,
coherence, effectiveness, efficiency, sustainability andimpact). To the extent
possible, quantitative and qualitative data will becollected, validated,
triangulated and analysed. The evaluation process willinclude desk reviews,
interviews, and observation. The proposed methodology issuggestive and can be
adjusted by the Evaluator if considered necessary, inaccordance with the scope
and purpose of the evaluation and in consultationwith the WLF team.
The Project will be evaluated against criteria such as its relevance
toorganization mission and objectives of organization, the validity of project
design,project effectiveness, the efficiency of resource use, the impact
orientationand sustainability. Tosummarize, the external independent evaluation
should address the following keyquestions:
1. Relevance and value to organizationstrategy and mission statement
· To what extent does theproject design take into account the needs of
beneficiaries and stakeholders?
· To what extent does theproject design align with WLF’s mission and
objectives?
2. Validity and relevance of design
· Are the planned project objective,outcomes, outputs and activities
aligned?
3. Project achievements and effectiveness
· To what extent has theproject achieved their stated objectives?
· What are the main factors–internal to the project and external- that
have hindered the project’s abilityto reach the desired results thus far?
4. Efficiency of resource use
· To what extent havetechnical and administrative support been sufficient
and adequate to meetproject objectives?
5. Effectiveness of grant management; and
· Towhat extent have the WLF grant management support been adequate to
meet projectobjectives?
6. Impact orientation and sustainabilityin relevance to the target
community
· To what extent are plannedresults of the project likely to be sustained
and/or scaled up and replicatedby stakeholders?
· What further concretesteps could be taken to increase the sustainability
of the results?
Evaluator’sResponsibilities and Deliverable1. KeyResponsibilities
· The design, planning andimplementation of the evaluation and the
write-up of the evaluation report,using an approach agreed by WLF and for
delivering in accordance with the WLF’sspecifications and timeline
· Consulting and liaising,as required, with WLF, stakeholders and
partners to ensure satisfactorydelivery of all deliverables
· Making herself/himselfavailable, if required, to take part in briefings
and discussions, online orother venue, on dates to be agreed
2. KeyDeliverables
· InceptionReport with Methodology
The inception reportshould detail the evaluator’s understanding of what is
being evaluated and why,showing how each evaluation question will be answered
by way of: proposedmethods; proposed sources of data; and data collection
procedures. Theinception report should also include an evaluation framework
matrix, astakeholder list, proposed interview tools/guides, proposed schedule
of tasks,activities, deliverables, and outline of final report
· Validation Workshop
To be conducted to validate theinitial finding with the respondent and key
stakeholders. The activity will becarried out after the completion of data
collection. Results of this workshopwill be used as additional source of
information during analysis and reportwriting
· Draftof Evaluation Report
TheEvaluator will submit draft of evaluation report to WLF. The
recommendations, lessons learned, and emerging good practicesshould be
documented in the draft evaluation report
· Presentationof Draft Report
A presentation should be prepared for the WLF on the draft report, tobe used
during the debriefing
· FinalEvaluation Report
To be submitted to WLF asper report outline and timeline. The quality of the
report will be determinedbased on quality standards defined by WLF. The report
should also, asappropriate, include specific and detailed recommendations by
the Evaluatorbased on the analysis of information obtained. The report should
also include aspecific section on lessons learned and good practices that are
relevant forbetter performance and delivery for future project or could be
replicated orthose that should be avoided
Proposed Time Line
The evaluation is foreseen to be undertakenin the time period of October 2020
to January 2021 with the aim to submit thefinal evaluation report to WLF no
later than mid-January 2021.
Proposal SubmissionCriteria
The following will be considered minimum contentsof the proposal. Please submit
in the order listed:
- Proposed methodology and tools for the evaluation design
- Proposed team composition (clearly stating roles and responsibilities of
each team member)
- Financial proposal to conduct the evaluation, complete with breakdown of
man-hours or days required to conduct each stage of the preparation, data
collection tools development, data collection and analysis, field visit/travel,
report writing and presentation
- Most current Curriculum Vitae, highlighting related experiences and skills
to the required scope of work
- Sample of previous evaluation reports
Essential Requirements:
- A bachelor’s degree in political sciences, international relations,
development economics or any relevant social sciences. Master’s degree is
preferred
- A minimum of 5 years of experience conducting monitoring and evaluation of
development programs in impoverished regions in Indonesia, particularly in
carrying rigorous evaluation methodology
- Demonstrable research and strong analytical skills
- Demonstrable strong knowledge on village governance, Village Law
(Undang-Undang Desa) and village-related tourism (especially on the newly
stipulated District Regulation on Tourism Village Program in Sumba Barat Daya).
- Experience in workshop facilitation
- Strong interpersonal skills in a multicultural setting, experienced in
engaging community leaders and key government officials at subnational levels.
Proposals must be sent to support@xxxxxxxxx by 27 September 2020 at 05:00
PMJakarta time at the latest.