Terms of Reference
Independent External Evaluation (Revised)
|
Project Title
|
: Strengthening the Concept of Basic Literacy Education Curriculum Through
Local Potential for Elementary Schools in Sumba Barat Daya
|
|
Funder
|
: William & Lily Foundation
|
|
Project Period
|
: December 2017 – November 2020
|
|
Evaluation Period
|
: October 2020 – January 2021
|
Introduction &Rationale for Evaluation
The William & Lily Foundation(WLF) is an Indonesian-based philanthropic
foundation established in 2009 as anoutgrowth of the philanthropic legacy of
William and Lily Soeryadjaya. As anactive grant-making foundation, WLF works
closely with implementation partnerson four focus areas: education, health
care, economic empowerment and enablingenvironment. WLF is committed to
impactful and responsible interventions in itsefforts to empower
underprivileged communities across Indonesia. Although thescope of WLF
philanthropic endeavours is countrywide, its current geographicalfocus centres
on eastern Indonesia, particularly on the island of Sumba.
In December 2017, WLF formed apartnership with Kuark International, in
implementing a two-year programentitled Strengthening the Concept of Basic
Literacy Education Curriculum throughLocal potential For Elementary Schools in
Sumba Barat Daya. This project iscalled Kelas Lentera. The projectaims to
(1)improve the quality of teacher’s teaching and students' basic literacy
andnumeracy skills by strengtheningteachers' capacity in implementing various
learning strategies and (2)improve students' cognitive development by applying
a holistic approach whichalso focuses on motor development. The beneficiaries
of this project arethe school principals, teachers and students in three
elementary schools inSumba Barat Daya."
As per WLF’s policy, this project is subjectto external independent evaluation.
The main purpose of this activity is to evaluate the effectiveness of project
implementationand the appropriateness of chosen interventions to target
beneficiaries. WLF therefore is seeking individual or a team of evaluators to
conductthis evaluation.
Purpose, Scope andUsers of Evaluation
The purpose of this external independentevaluation is to confirm efficacy of
the program approach, particularly with theaddition specific interventions on
the second half of the program such as Brainfit activity and the use of
alternative communication media (i.e., WhatsApp,etc.) and to validate results
and potential replication of this project. Theevaluation will cover the
project's various components (such as the expected outcomes,outputs and
activities) as reflected in the project document as well assubsequent
modification and alterations made during its implementation.
The main user of findings andrecommendations from this evaluation will be the
William and Lily Foundation. Other potential users may include but notlimited
to the Foundation’s implementing partners and relevant stakeholders
asnecessary.
Methodology
Theevaluation will be based on a participatory approach, involving a wide range
ofselected key Stakeholders and beneficiaries. The evaluation will use
bothprimary and secondary data sources for probing the progress and for
generatingevidence in support of the findings. Overall, the evaluation should
refer theOECD-DAC criteria for evaluation (wherepossible) which is looking into
the elements of relevance, coherence, effectiveness, efficiency,sustainability
and impact. To the extent possible,quantitative and qualitative data will be
collected, validated, analysed andtriangulated. The evaluation process will
include a desk review, interviews,and observation. The proposed methodology is
suggestive and can be adjusted bythe Evaluator if considered necessary, in
accordance with the scope and purposeof the evaluation and in consultation with
the WLF team.
Evaluation Criteriaand Suggested Questions
The Project will be evaluated against criteria such as its relevance
toorganization mission and objectives of organization, the validity of project
design,project effectiveness, the efficiency of resource use and potential of
replicationor scalability. The evaluation should address the following key
questions:
1. Relevanceand value to organization strategy and mission statement
· To whatextent does the project design take into account the needs of
beneficiaries andstakeholders?
2. Validity and relevance of design
· To whatextent is the monitoring and evaluation framework appropriate in
assessing theproject’s progress and useful in refining the project design?
3. Projectachievements and effectiveness
· To whatextent is the program implementation address the needs and
challenges ofbeneficiaries and stakeholders?
· What arethe main factors –internal to the project and external- that
have hindered theproject’s ability to reach the desired results thus far?
4. Efficiency of resource use
· To whatextent have technical and administrative support been sufficient
and adequateto meet project objectives?
5. Potential of replication orscalability in relevance to the target
community
· To whatextent are planned results of the project likely to be
replicated and scaled upby stakeholders?
Evaluator’sResponsibilities and Deliverables
1. KeyResponsibilities
· The design, planning andimplementation of the evaluation and the
write-up of the evaluation report,using an approach agreed with WLF and for
delivering in accordance with the WLF’sspecifications and timeline
· Consulting and liaising,as required, with WLF, stakeholders and
partners to ensure satisfactorydelivery of all deliverables
· Making herself/himselfavailable, if required, to take part in briefings
and discussions, online or othervenue, on dates to be agreed
2. KeyDeliverables
· InceptionReport with Methodology
The inception reportshould detail the evaluator’s understanding of what is
being evaluated and why,showing how each evaluation question will be answered
by way of: proposedmethods; proposed sources of data; and data collection
procedures. Theinception report should also include an evaluation framework
matrix, astakeholder list, proposed interview tools/guides, proposed schedule
of tasks,activities and deliverables
· Draftof Evaluation Report
Independentexternal consultant will submit draft evaluation report to WLF. The
recommendations, lessons learned, and emerging good practicesshould be
documented in the draft evaluation report. WLFwill provide feedback on the
draft evaluation report
· Presentationof Draft Report
A presentation should be prepared for the WLF on the draft report, tobe used
during the debriefing
· FinalEvaluation Report
To be submitted to WLF asper report outline and timeline. The quality of the
report will be determinedbased on quality standards defined by WLF. The report
should also, asappropriate, include specific and detailed recommendations by
the Evaluatorbased on the analysis of information obtained. The report should
also include aspecific section on lessons learned and good practices that are
relevant forbetter performance and delivery for future project or could be
replicated orthose that should be avoided
Proposed Time Line
The evaluation is foreseen to be undertaken in the time period, October2020 to
January 2021 with the aim to submit the final evaluation report to WLF nolater
than mid-January 2021.
Proposal SubmissionCriteria
The following will be considered minimum contentsof the proposal. Please submit
in the order listed:
- Proposed methodology and tools for the evaluation design
- Proposed team composition (clearly stating roles and responsibilities of
each team member).
- Financial proposal to conduct the evaluation, complete with breakdown of
man-hours or days required to conduct each stage of the preparation, data
collection tools development, data collection and analysis, field visit/travel,
report writing and presentation
- Most current Curriculum Vitae, highlighting the related experiences and
skills to the required scope of work.
- Sample of previous evaluation reports
Essential Requirements:
- A bachelor’s degree in education sciences or any relevant social sciences,
Master’s degree is preferred
- A minimum of 5 years of experience conducting monitoring and evaluation of
development programs in impoverished regions in Indonesia, particularly in
carrying basic evaluation methodology
- Demonstrable research and strong analytical skills
- Demonstrable strong knowledge on basic literacy education in elementary
schools, having strong pedagogic background on literacy and numeracy
particularly for primary school and knowledge of inquiry-based methods
- Strong interpersonal skills in a multicultural setting, experienced in
engaging principals, teachers, Students in elementary schools and key
government officials at subnational levels
Proposals must be sent to support@xxxxxxxxx by 27 September 2020 at 05:00
PMJakarta time at the latest.