Terms of Reference
for Research and Evaluation
Central Sulawesi Emergency Response
&
Disaster Emergency Committee (DEC) Phase 2 Final Evaluation
June 2020
1. PROJECT Background
Save The Children (STC) has been present in Indonesia since 1976, and became a
locally registered foundation in Indonesia, known as Yayasan Sayangi Tunas
Cilik (YSTC), in 2014. YSTC is one of the largest child-rights organisations in
Indonesia, with over 500 staff, and delivering programmes across a number of
thematic areas including health, nutrition, child protection, education and
child poverty. YSTC has significant humanitarian experience, from the El Nino
event in Sumba, Lombok Earthquake, Central Sulawesi Earthquake and Tsunami to
the recent Covid-19 response. In these emergencies, YSTC responded with
national staff through a holistic emergency response.
On Friday 28 September, a series of strong earthquakes struck the Central
Sulawesi province of Indonesia. The strongest earthquake, registered at a
magnitude of 7.4, was only 10 km deep, with its epicentre close to the
provincial capital, Palu. The earthquake triggered a tsunami striking beach in
Palu and Donggala. The earthquakes, tsunami and resulting liquefaction and
landslides have caused devastating damage and high loss of life, affecting the
lives of 1.5 million people including 375,000 children. In October 2018, STC
started its operation in Central Sulawesi after the earthquake and tsunami hit
the province.
STC has operational presence in three city/district, namely Palu, Sigi, and
Donggala with two operation field offices located in Palu and Donggala. STC
implements programs in six sectors: child protection, education, water
sanitation & hygiene (WASH), health & nutrition, shelter, and food security &
livelihood (FSL).
The overall response goal is: Contribute to immediate and lasting change in the
lives of earthquake and tsunami -affected children and their families: through
urgent humanitarian assistance, continued access to basic services and with
active participation in their own recovery. STC focus on three strategic
priorities during the response, there are
* 1). To maximise impact for the hardest to reach through integration;
* 2) to leverage impact supporting the government with technical expertise;
* 3) to be a lolised response through strengthened national capacity.
Education and Child Protection, the largest sectors, are at the centre of all
programme design for geographical integration; this is complemented by further
sector level integration. By ensuring programme, design and operations are
integrated we expected the efficiency in the use of resources is increased,
and, more importantly, the most vulnerable families receive a comprehensive
package of support. To accommodate this, STC also developed response framework
to operationalize the impact from each sector to the affected communities as
follow:
Sector
Objectives
Outcome
Child Protection
Ensure life-saving protection and psychosocial well-being and resiliency
support for children and families, including Unaccompanied and Separated
Children (UASC), impacted by the Sulawesi earthquake and tsunami
Outcome 1. Family separation is prevented and responded to, and unaccompanied
and separated children are cared for and protected according to their specific
needs and best interest
Outcome 2. Girls and boys' psychosocial well-being, positive coping mechanisms
and resiliency are strengthened
Outcome 3. Girls and boys are protected from violence, including sexual
violence, and exploitation and survivors of violence have access to age and
culturally appropriate information as well as a safe, responsive and holistic
response
Education
Boys and girls (aged 4-14) affected by the earthquake and tsunami have access
to safe, protective, inclusive and age appropriate learning opportunities, in
displaced and host communities
Outcome 1. Children affected are accessing safe, protective and equipped
learning spaces
Outcome 2. Improved knowledge and skills of teachers and community volunteers
to deliver life-saving knowledge and skills to affected children
Outcome 3. Improved capacity of parents and caregivers to support children's
social and emotional learning
Outcome 4. Increased participation of children on risk reduction and disaster
preparedness in school and community.
Outcome 5. Strengthened capacity of education sector at district and
sub-district levels
Nutrition
To protect nutritional status and contribute to a reduction in morbidity and
mortality amongst children, pregnant and lactating mothers
Outcome 1.1 Caregivers with children under 2 years and pregnant women in the
affected population have access to IYCF-E services supporting recommended IYCF
practices
Outcome 1.2. Adequate complementary feeding and nutritional sufficiency in
pregnant and breastfeeding women is supported and protected during the emergency
Outcome 1.3. Strengthen national policy, capacity and systems to deliver an
effective IYCF-E response for the current emergency and future emergencies
Outcome 1.4. Control, monitoring and follow up of BMS distributions and
donations
Outcome 2.1. Children and PLWs with acute malnutrition are identified and
referred for treatment
WASH
Targeted children and families have access to and use safe water and
sanitation, and adopt improved hygiene practices
Outcome 1. Targeted children and families have access to and use safe water and
sanitation and adopt improved hygiene practices
Shelter
Vulnerable children have better access to safe, protective, living and learning
environments.
Outcome 1. Vulnerable children have better access to safe, protective, living
and learning environments.
Outcome 2. Targeted households are enabled to build adequate transitional
shelter (for midterm shelter solution) that provides protection from adverse
weather during the monsoon seasons.
Food Security & livelihood
The most vulnerable and hardest to reach household households are able to meet
basic household needs and fill food/nutrition gaps in the short and
medium-term, while launching recovery activities for communities and households
as soon as possible
Outcome 1. 6,000 vulnerable, earthquake-effected households supported with
multi-purpose cash grants are better able to meet their basic needs while
limiting their reliance on negative coping strategies
Outcome 2. 50 community-led recovery projects supported with cash-based and
in-kind support provide greater voice and participation for effected
communities during the recovery process
Outcome 3. 1,500 vulnerable, earthquake-effected women receiving fresh food
vouchers have increased access to nutritious food for their children as
livelihoods and income recover
Outcome 4. 1,000 vulnerable, earthquake-effected adolescent/youth equipped with
skills and inputs to access a more stable income reduce their involvement in
damaging economic activities
Outcome 5. 1,500 vulnerable, earthquake-effected households receiving
cash-based and in-kind support to recovery their livelihood activities
stabilise and increase their income
Up to now, the Central Sulawesi Emergency Response has reached around 218,253
beneficiaries including 104,807 children through various activities. The
response is supported by various donors from different countries with total
amount is approximately USD 17 Million for all sectors. The response is also
supported by the Disaster Emergency Committee (DEC) from United Kingdom (UK).
The DEC has supported Central Sulawesi Emergency Response through two phases
where the first phases was delivery on response phase (November 2018 until
March 2019) with total amount approximately GBP 2.1 Million while the second
phase is delivery during April 2019 until September 2020 with total budget is
GBP 2.3 Million.
In Phase 2, the DEC supported activities were focused to FSL, WASH, Shelter,
and Education sectors in our priority villages in Sigi and Donggala with the
following outcome:
Outcome 1. Adolescent girls in Central Sulawesi are supported to develop the
skills necessary to conduct viable and dignified income generating activities.
Outcome 2. Community groups in Central Sulawesi are support to design and
implement recovery projects.
Outcome 3. Affected children and their families in Central Sulawesi have
improved access to clean, safe and equitable quantities of water
Outcome 4. Affected children and their families in Central Sulawesi have
improved hygiene and sanitation behaviour
Outcome 5. Affected community members have raised awareness and increased
skills to build safer and stronger shelters.
Outcome 6. Affected households in Central Sulawesi are enabled to build
adequate transitional shelter (for midterm shelter solution) to minimise health
and protection related risks
Outcome 7 School committees are supported to carry out minor repairs to
classrooms and school grounds.
Through community engagement approach, STC has already reached around 30,000
beneficiaries (up to March 2020) whereas half of them are female beneficiaries.
All the project activity was designed to engage community, including children
closely. Through our complaint and feedback Mechanism (CFM) community also have
opportunities to address their complaint and feedback via available channel
such as hotline number, complaint and feedback box, face to face with staff and
community/children consultation. STC has established strong and credible
relations with the Government of Indonesia (GoI) and national civil society and
is able to scale up and provide relief efforts with no restrictions.
2. EVALUATION CONTEXT
Central Sulawesi is a new response area for STC, prior to the crisis STC had an
office in Makassar, South Sulawesi. The decision to respond in Central Sulawesi
indicated YSTC's commitment and ambition to programme in the region for the
foreseeable future. Currently, STC is operating two field offices: Donggala
Office located in Tambu Sub District that covers Donggala operation and Central
West Office located in Palu to cover Palu and Sigi area. Each office is led by
a Senior Field Manager (SFM) who report to Humanitarian Directors based in
Jakarta.
STC has established strong and credible relations with the Government of
Indonesia (GoI) and national civil society and is able to scale up and provide
relief efforts with no restrictions. In Central Sulawesi Response, STC working
closely with the Provincial Response Lead along with relevant
Provincial/District Office, such as Badan Penanggulangan Bencana Daerah
(BPD)/Provincial Disaster Management, Education Office, Social Affair Office,
and Health Office. Along with other humanitarian organization and UN agency,
STC contribute in the relevant cluster activity, including jointly coordinating
the Education cluster with UNICEF.
The Central Sulawesi response has been rated as high quality against
international and Indonesian standards and are coordinated with the Indonesian
government to build technical capacity. The technical quality team also
developed quality benchmark that is referred by program implementation team as
a standard for the activity. The quality benchmark was developed according to
technical international humanitarian standards - SPHERE Standards, Child
Protection Minimum Standard (CPMS) and Inter-Agency Network for Education in
Emergencies (INEE) and Core Humanitarian Standard (CHS).
Six months after the disaster, STC reviewed the Master Strategy to give more
context to the recovery period, as well as to enhance the effectiveness and
efficiency of its intervention. Integration is one approach that was key in the
programme design from the beginning. However, the implementation was still
sectoral, so Save the Children established a Community Engagement team to
ensure the sectoral integration implementation at field as well as to mobilize
the community effectively. Alongside this, the field team also prioritised
focus on priority villages to ensure the most vulnerable communities received
integrated assistance.
The response also has several delays: it was not fully operational during
March- April 2019 due to the National Election and its campaign period, (we did
not deliver any distribution as per request by the government). We also had to
minimize our activity during Ramadhan and Eid Holiday during May - June 2019.
The response itself has been reviewed twice already in the initial six months
as a part of STC Category 2 emergency response: an Operation Cost Review (OCR)
to assess the operational aspect and a Real Time Review (RTR) to assess the
program quality during the response. Each review suggested several action
plans, which have been followed up both by National and Field team. This
evaluation should focus specifically on the period six months onward from the
disaster - the same period from when the STC funding for DEC Phase 2 was
activated.
In March 2020, the Government of Indonesia (GOI) declared the global COVID-19
outbreak as a national emergency, restricting movement and activities outside
the home to avoid the spread of the virus. This has also affected STC's
movements on the ground with the postponement of several activities and others
adapted onto online platforms to adjust to the COVID-19 situation. STC have
also adjusted their activity to support the Government Response on COVID-19 in
Central Sulawesi. Hence, this final evaluation should also take account these
circumstances both for the operations and program evaluation, as well as data
collection processes.
3. PURPOSE & Scope of evaluation
3.1 Purpose and objective
Purpose
This evaluation is being conducted at the end of the Central Sulawesi Emergency
Response - and in the final period of DEC Phase 2 funding. It will build upon
the sectoral baseline, internal end line assessment, internal assessment as
well as regular monitoring.
The primary focus of the current evaluation is to provide information about the
results of Central Sulawesi Emergency Response, including its success and
failure as part of our accountability to affected population as well as
relevant stakeholders, especially our donors, so STC can improve the quality of
its responses in the future.
Objectives
There are several objectives for the current evaluation as follows:
* To describe, assess, review and critically evaluate the achievement of
results - both intended and unintended, positive and negative - and identify
major factors which influence those results.
* To examine the response/project design relevance and implementation
fidelity
* To gain insights into the level of beneficiaries and stakeholder (e.g.,
community and local/national government, implementing partners, donor)
satisfaction and expectation towards the response activities.
* To document the lessons learned from the project implementation,
including those pertaining to approaches, sector integration, gender
mainstreaming, child participation, project management, and partnerships.
* To provide recommendations according to the findings of the evaluation to
enable STC to sustain the benefits of the project and effectively adapt its
Humanitarian Strategy for future humanitarian crisis response both in Indonesia
and globally.
3.2 Scope
The evaluation will focus on several considerations as follow:
* The evaluation will focus on the implementation of the activity from six
months after the disaster
* The evaluation will focus on the implementation of the whole emergency
response that conducted by STC across the sectors along with the implementation
and contribution of the DEC Phase 2 Funding
* The evaluation needs to take into consideration the Development
Assistance Committee (DAC) and CHS indicator to measure the success of response
quality and operation, as well as lessons learned
* The evaluation also needs to take into consideration all operational
activity due to the COVID-19 crisis situation that may impact project
implementation, as well as the planned evaluation implementation
3.3. Stakeholders/audiences
The key stakeholders/audiences for this evaluation are:
Stakeholder
Further information
Project donor
Pool Appeal Fund; DEC
Primary implementing organisation
Save the Children Indonesia
Implementing partners
N/A
Government stakeholders
BPBD
Central Sulawesi Government
Provincial and District of Social Affair Office
Provincial and District of Education Office
Provincial and District of Health Office
Community groups
Priority Villages including Community Based Child Protection (CBCP)
Beneficiaries
Children and adults involved in the programme/project and the evaluation
International development/ humanitarian community
DEC received Organization in Central Sulawesi, Relevant Cluster Coordination
The selected evaluation team will be required to propose how the evaluation
findings will be shared with each of the different stakeholders in the table
above, particularly outlining how reporting back to communities, beneficiaries
and children will be conducted in an accessible and child friendly manner.
3.4. Evaluation Questions
The primary question for the evaluation is how the response strategy is used
and the benefits on the implementation of humanitarian response in Central
Sulawesi.
The Evaluation team will be required to undertake consultation with the SC
Evaluation Project Manager and the Evaluation Working Group at the commencement
of the project in order to further refine the evaluation questions.
Cross cutting questions
In addition, the following specific questions should also be considered for
summative evaluations:
Criteria
Questions
Gender sensitivity
* How has the response and project considered gender sensitivity both in
the design and its implementation of activities?
* Has the project incorporated different needs and accessibility of boys
and girls, men and women, and non-binary individuals?
* What are the gender gaps that the project addressed and what remaining
aspects need to be considered further?
Social inclusion
* How did the response and project consider inclusion of vulnerable groups
in the design and its implementation of activities?
Child participation
* How have the children, their needs and desires been consulted and
accounted for in project design and implementation?
* How were children meaningfully involved in the project design and
implementation? What impact did this have on the outcome of the project?
Child rights programming
* How has the project design and implementation considered child rights
approaches?
Child safe programming
* Have the response and project been designed, planned, implemented and
monitored to ensure it is safe for children?
* How has child safety been integrated into the project design and
implementation of activities? What aspects of the project make children feel
safe?
* How has the project assessed the risks for children and do these risks
still exist to date? Have they been reduced, controlled and managed by the
minimising actions? Are there new risks? What further measures do we need to
implement to reduce, remove and control these new emerging risks.
Accountability
* How has the project approached accountability to children?
* How did feedback from children influence decision making?
4. Evaluation Methodology
4.1 Research design and sampling
It is expected that this evaluation will involve:
? Mix methods (quantitative and qualitative methods) for relevant group
? Purposive Sampling for Stakeholder, such as government, relevant NGO,
relevant Cluster Coordination Group, including internal staff
? Simple Random Sampling for Beneficiaries from the beneficiaries list Data
All primary data collected during the course of the evaluation must facilitate
disaggregation by gender, age, location, disability status, including
vulnerability status/group. STC will provide guidance on tools and
classification schemes for this minimum dataset.
Existing STC data sources that can be drawn on in the evaluation include:
? Response Strategy, including master log frames
? Response Update
? Project Report
? Internal Review (RTR, OCR)
? DEC 2 Project Documents
? Monitoring, Evaluation, Accountability, Learning (MEAL) Data (e.g. Post
Distribution Monitoring/PDM, Accountability in Brief, Outcome Monitoring Report)
? Communication Materials, including Case Study
STC may provide enumerators to assist with primary data collection. Data
triangulation is expected for this evaluation. It will be a requirement of the
Evaluation team to source additional external data sources to add value to the
evaluation, such as government administrative data.
A range of project documentation will be made available to the Evaluation team
that provides information about response strategy, implementation and operation
of the project
The Evaluation team is required to adhere to the STC Child Safeguarding, Data
protection and Privacy policies throughout all project activities.
4.2 Methodologies
We may expect to have this methodology for the evaluation survey, but would not
be limited to:
1. Desk review of key documents, including strategy documents, prior
evaluation reports, monitoring reports and other documents judged relevant.
2. Literature search and review of material on the environment in which
the project operates, and recent developments which impact objectives and
activities
3. Interviews with key project staffs, representatives of the project's
stakeholders (local government, implementing partners, key informants, past
evaluators, donors, etc.)
4. Probabilistic sample surveys of targeted beneficiaries or groups of
stakeholders
5. Focus group discussions with targeted beneficiaries and stakeholders
6. Other participatory approaches, such as "most significant change"
7. Case studies, which usually require site visits to judge the outcomes
and impacts
8. Physical inspection of some products or facilities and/or measurement
of environmental factors affecting results.
9. Independent assessment of prior baseline or end line
survey/assessments.
10. Analysis of results by methodologies such as "before/after" comparison of
baseline and end line; or "with/without" comparison with a control group'
11. Attendance at beneficiary meetings, workshops, and training activities.
12. Review of evaluations and annual reports of other project in the same
sector and with the same/similar target population
There will be discussion between the evaluation steering committee and the
selected contractor/consultant on the methodology and work plan. This occurs
after the contractor have had the chance to review background materials and
monitoring data, and after speaking with key project personnel. This
discussion can either take the form of an informal exchange of ideas over a
select period of time, or the drafting by the contractor of a formal report or
INCEPTION REPORT.
4.3 Ethical considerations
It is expected that the evaluation will adhere to ethical guidelines as
outlined in evaluation association (e.g., the American Evaluation Association's
Guiding Principles for Evaluators). A summary of these guidelines is provided
below, and a more detailed description can be found at
www.eval.org/Publications/GuidingPrinciplesPrintable.asp<http://www.eval.org/Publications/GuidingPrinciplesPrintable.asp>.
It is expected that this evaluation will be:
* Child participatory. Children should be meaningfully involved in the
evaluation as a holistic process and not only as informants. Refer to the
Practice Standards in Children's Participation (International STC Alliance
2005<https://resourcecentre.savethechildren.net/library/international-save-children-alliance-2005-annual-report>);
and Global Indicator technical guidance (SCI M&E handouts Package, Volume 2).
* Inclusive. Ensure that children from different ethnic, social and
religious backgrounds have the chance to participate, as well as children with
disabilities and children who may be excluded or discriminated against in their
community.
* Ethical: The evaluation must be guided by the following ethical
considerations:
o Respect for People - evaluators respect the security, dignity and
self-worth of respondents, project participants, clients, and other evaluation
stakeholders.
* Informed Consent - all participants are expected to provide informed
consent following standard and pre-agreed upon consent protocols. This is to
ensure that they can decide in a conscious, deliberate way whether they want to
participate.
* Child safeguarding - demonstrating the highest standards of behaviour
towards children
* Sensitive - to child rights, gender, inclusion and cultural contexts
* Openness - of information given, to the highest possible degree to all
involved parties
* Confidentiality and data protection - measures will be put in place to
protect the identity of all participants and any other information that may put
them or others at risk.
* Public access - to the results when there are not special
considerations against this
* Broad participation - the relevant parties should be involved where
possible
* Reliability and independence - the evaluation should be conducted so
that findings and conclusions are correct and trustworthy
* Systematic Inquiry - evaluators conduct systematic, data-based
inquiries.
* Competence - evaluators provide competent performance to stakeholders.
* Integrity/honesty - evaluators display honesty and integrity in their
own behavior and attempt to ensure the honesty and integrity of the entire
evaluation process.
* Responsibilities for general and public welfare - evaluators
articulate and take into account the diversity of general and public interests
and values that may be related to the evaluation.
It is expected that:
* Data collection methods will be age and gender appropriate.
* Evaluation activities will provide a safe, creative space where children
feel that their thoughts and ideas are important.
* A risk assessment will be conducted that includes any risks related to
children or young people's participation.
* Informed consent will be used where possible.
The Evaluation team [will/will not] be required to obtain approval from a Human
Research Ethics Committee. STC will provide assistance with this process.
5. Expected ACTVIITIES AND Deliverables
The evaluation deliverables and due dates (subject to the commencement date of
the evaluation) are outlined below. The [Evaluation team lead] will advise [SC
Evaluation Project Manager] immediately of any risks or issues that may impact
on their ability to provide the deliverables by these due dates. [Use the below
table as a guide and update as relevant to your project.]
5.1. Expected Activities
The following is an example of a plan of expected activities. A Gantt chart
can also be used.
Activities
Nmber of days
Expected timeline
1. Desk review, literature search and discussions with key project staff
4
15 - 18 July 2020
2. Develop and submit inception report for approval
3
20 -22 July 2020
3. Develop data collection instruments
3
23 25 July 2020
4. Develop and facilitate data collection training
3
25 - 27 July 2020
5. Field data collection
10
27 July - 5 August 2020
6. Report on training and completion of data collection
1
6 August 2020
7. Clean and analyze data
5
7 - 11 August 2020
8. Prepare and submit draft report
4
12 - 15 August 2020
9. Finalize report in line with SC feedback
5
17 -21 August 2020
10. Present findings to SC Indonesia staff and office representative as
relevant
1
24 August 2020
Total expected workdays:
40
5.2. Deliverables and Due Dates
The following is an example of details on deliverables and deadlines. Indicate
the language required for all deliverables and whether they need to be
translated, and what role, if any, the evaluators are expected to play in such
translations or reviews of the translated text. Also state any page
limitations, perhaps allowing for annexes of unlimited length, and indicate
whether raw data or any special tabulations are to be provided and in what form
No
Deliverable
Due Date
1
The Evaluation Team is contracted and commences work
13 July 2020
2
The Evaluation Team will facilitate a workshop with the relevant stakeholders
at the commencement of the project to develop the Inception report. The
inception report will include:
* evaluation objectives and key evaluation questions
* description of the methodology, data sources, draft data collection tools
(preferably against the key evaluation questions) and sampling considerations
* caveats and limitations of evaluation
* key deliverables, milestones and timelines
* risk and issue management plan
* a stakeholder communication and engagement plan
* consultation protocols for consulting with children and other vulnerable
groups (if applicable)
* Logistical or other support required from STC
Refer to the Inception report guideline. Once the report is finalised and
accepted, the evaluator/ evaluation team must submit a request for any change
in strategy or approach to the evaluation manager or the steering committee.
14 July 2020
3
Ethics submission (if applicable):
Should approval from a Human Research Ethics Committee be required, an ethics
submission should include:
* study protocols (participant recruitment, data security and storage,
consent and confidentiality etc.)
* considerations for consulting with children and other vulnerable groups
(if applicable)
* participant information statement and consent forms
22 July 2020
4
A concise 1-page Progress Report is to be submitted every two weeks
implementing progress against the evaluation plan including:
* progress over the last period
* risks and issues management report
* key scheduled activities and deliverables for the next period
Every two weeks
5
Data collection tool
* Survey instrument Available
* Data collection Start conducted
22 July 2020
6
An Interim/Preliminary Report* including a summary of formative findings from
the evaluation.
The focus will be on:
* Summary of interim findings
* Any emerging programme issues or risks (if applicable)
* Key tasks for the next stage of the evaluation and any proposed
refinements or changes to methodology (if applicable)
5 August 2020
7
An Evaluation Report*
Maximum 40 pages, exclude annexes
(Draft Version) including the following elements:
* Executive summary
* Background description of the Programme and context relevant to the
evaluation
* Scope and focus of the evaluation
* Overview of the evaluation methodology and data collection methods,
including an evaluation matrix
* Findings aligned to each of the key evaluation questions
* Specific caveats or methodological limitations of the evaluation
* Conclusions outlining implications of the findings or learnings
* Recommendations
* Annexes (Project logframe, Evaluation TOR, Inception Report, Study
schedule, List of people involved)
A consolidated set of feedback from key stakeholders will be provided by STC
within [X] days of the submission of the draft report.
14 August 2020
8
Data analyses including all raw data, databases and analysis outputs
7 August 2020
9
Final Evaluation Report* incorporating feedback from consultation on the Draft
Evaluation Report
21 August 2020
10
Knowledge translation materials:
* PowerPoint presentation of evaluation findings
* Evidence to Action Brief**
24 August
*All reports are to use the STC Evaluation report template [unless another
format is required by the project donor]. Please also refer to STC technical
writing guide.
** The Evidence to Action Brief is a 2-4 pages summary of the full report and
will be created using the STC Evidence to Action Brief template.
All documents are to be produced in MS Word format and provided electronically
by email to the SC Evaluation Project Manager. Copies of all PowerPoint
presentations used to facilitate briefings for the project should also be
provided to STC in editable digital format.
6. Reporting and governance
The final evaluation will be governed by a Steering Committee that will be the
final decision for every deliverable from the selected evaluator. the steering
committee will be involved in each evaluation steps and selected evaluator need
to have its approval to move to next step. The steering committee consist of
programmatic and operation division that involve in Central Sulawesi response.
The Evaluation team lead is to provide reporting against the project plan. The
following regular reporting and quality review processes will also be used:
* Verbal reporting each week/biweekly to the Steering Committee STC
Evaluation Project Manager]by outlining progress made over the previous period.
* A written Progress Report (1-page) by email to the STC Evaluation Project
Manager every fortnight documenting progress, any emerging issues to be
resolved and planned activities for the next month.
The PDQ Director will be accountable for approving the Final Evaluation Report.
7. Evaluation team
To be considered, the Evaluation team members together must have demonstrated
skills, expertise and experience in:
* Designing and conducting outcome evaluations in humanitarian setting
* Conducting research and/or evaluation in the field of child right issues,
particularly in relation to child protection, food & security livelihood,
health & nutrition, and education.
* Leading socio-economic research, evaluations or consultancy work in
Indonesia that is sensitive to the local context and culture, particularly
gender equality and child right issue
* Conducting ethical and inclusive research and/or evaluation involving
children and child participatory techniques
* Conducting ethical and inclusive research and/or evaluation involving
marginalised, deprived and/or vulnerable groups in culturally appropriate and
sensitive ways
* Managing and coordinating a range of government, non-government,
community groups and academic stakeholders
* Experience conducting research/evaluation in humanitarian contexts
* Sound and proven experience in conducting evaluations based on OECD-DAC
evaluation criteria, particularly utilisation and learning focused evaluations
* Extensive experience of theories of change and how they can be used to
carry out evaluations
* Report writing and presentation skills
There is a high expectation that:
* Members (or a proportion) of the evaluation team have a track record of
working together.
* A team leader will be appointed who has the seniority and experience in
leading complex evaluation projects, and who has the ability and standing to
lead a team toward a common goal.
* The team has the ability to commit to the terms of the project, and have
adequate and available skilled resources to dedicate to this evaluation over
the period.
* The team has a strong track record of working flexibly to accommodate
changes as the project is implemented.
8. Selection Criteria
Essential criteria
Understanding of requirements and proposal
1. The bidder has legitimate business/official premises, or that they are
registered for trading and tax as appropriate (Company Credential).
2. The bidder confirms they are not a prohibited party under applicable
sanctions laws or anti-terrorism laws or provide goods under sanction by the
United States of America or the European Union and accepts that SCI will
undertake independent checks to validate this.
3. Demonstrate your understanding of the study requirements and provide your
proposal for how you would approach the research/evaluation. Your proposal will
be assessed on whether the approach and methodology are robust, appropriate
(actionable, sensitive, responsible) and indicates that it will achieve the
study requirements.
4. Demonstrate your understanding of the deliverables and activities to be
implemented, by:
* Describing your proposed approach to project management and track
record of delivering on time and on budget.
* Providing a project plan with indicative timeline and defined roles
and responsibilities of team members.
Commercial criteria
Commercial Criteria is defined as the criteria which cover all financial
aspects of a supplier's response including pricing, rebates, free services,
discounts etc. The minimum weighting for standardized services for Commercial
Criteria is 50% of the total scoring.
Capability criteria
Demonstrated Experience
1. Demonstrate your experience and track record in conducting
[large/medium/small scale]:
a. [formative or process] evaluation using mixed-methods (qualitative and
quantitative data collection and analysis)
b. [impact/outcome or economic] evaluation using [experimental or
quasi-experimental] design and mixed-methods (qualitative and quantitative data
collection and analysis)
c. economic evaluation in a social services context (including either cost
effectiveness analysis, return on investment, cost-benefit analysis or cost
efficiency analysis)
d. [Applied, intervention, action, exploratory, longitudinal etc.] research
[or needs assessment/situational analyses etc.]
1. Demonstrate your experience and track record in conducting research
and/or evaluation in the field of [insert thematic area/s], particularly in
relation to [sub-thematic area]
1. Demonstrate your experience and track record of leading socio-economic
research, evaluations or consultancy work in [insert Country Name] that is
sensitive to the local context and culture, particularly [select all that
apply: child rights, gender equality, ethnicity, religion and minority groups
and/or other factors]
1. Demonstrate your experience and track record in conducting ethical,
inclusive and participatory research and/or evaluations involving: a) children
and b) marginalised, deprived and/or vulnerable groups
Bidder capacity
1. Describe the Project lead's coordination experience in leading
consultancy work, research and/or evaluations of similar scale, and managing a
team of diverse team of specialists.
1. Nominate the key personnel and resource pool who will perform the work in
relation to this contract. Your response will be assessed on whether the skills
and experience of key personnel adequately covers all areas of expertise and
experience required, and your combined team resources (number of members) as
required to implement the activities within the set timeframe. Please indicate
the 'personnel type' for each key personnel using the types outlined in the
table below for the next question.
Financial criteria
This personnel profile, schedule of rates and cost elements will be used for
the purposes of assessing cost effectiveness, as well as managing and
negotiating the agreed cost of deliverables, or agreed scope variations if
required.
Personnel allocations
1. Use and adapt the table below to outline how much time has been allocated
for the proposed team members to complete the required activities and
deliverables. Indicate the type and number of personnel allocated, for example
1x5 days (one individual for 12 days = 12 days) or 3x10 days (three individuals
for 10 days each = 30 days).
Activity/ Deliverable
[Project personnel]
[Project personnel]
[Project personnel]
[Project personnel]
[Add columns as needed]
Stage 1
Sub Total
Stage 2
Sub Total
Stage 3
Sub Total
TOTAL (All Stages)
Personnel Rates
1. Please detail the daily rates for key categories of project personnel in
the schedule below.
Expected number of days
Daily Rate
Taxes
TOTAL
[Project personnel]
[Project personnel]
[Add rows as needed]
TOTAL
Cost elements
1. Please specify all non-personnel related cost-elements that are budgeted
for in this proposal.
Element
Budget allocated
Taxes
TOTAL
Inputs (please specify)
Outputs (please specify)
Travel (please specify)
Support costs (please specify)
Other disbursements (specify)
The consultant must be willing to comply with Save the Children's relevant
policies and procedures:
1) Child Safeguarding Policy
2) Anti-Fraud, Bribery & Corruption Policy
3) Slavery & Human Trafficking Policy
4) IAPG Code of Conduct
5) Conditions of Tendering
The consultant should submit the Company Credential:
1. Copy of deed of establishment
2. Copy of tax registration number & certificate
3. Copy of institution registration certificate
4. Copy of trading/institution license
How To Submitting Proposals:
Proposal Documents, Supplier Declaration and Company Credential are sent via
e-mail to:
Procurement.Indonesia@xxxxxxxxxxxxxxxxxxx<mailto:Procurement.Indonesia@xxxxxxxxxxxxxxxxxxx>
Or
Save The Children Indonesia
Pic: Procurement Jakarta
Jl. Bangka IX No.40 A-B
Kel. Pela Mampang
Kec. Mampang Prapatan
Jakarta Selatan 12720
Closing date for application is up to July 7th, 2020. Time: 17:00 WIB
(Only short-listed candidates will be notified)
