Lowongan CARITAS GERMANY - External Evaluator for Shelter Project

Terms of Reference

Evaluation of the Shelter Projects of Caritas Germany in Central Sulawesi and Lombok

1.       Project Information
Project Evaluation Period:        01.10.2019 – 30.11.2019

Project Title:
“Central Sulawesi Earthquake and Tsunami Shelter Program”

Project Number:
P.416-020/2018

Project Period:
01.12.2018 – 30.11.2019

Overall Budget:
460.700 EUR

Project Donors:
Caritas Germany Own Funds

Project Partner:
Yayasan Habitat Kemanusiaan Indonesia (HFH)

Project Title:
“Early Recovery Temporary Shelter and WASH Interventions in the earthquake affected areas of Gunung Sari, West Lombok”

Project Number:
P.416-018/2018

Project Period:
11.01.2018 – 31.05.2019

Overall Budget:
216.000 EUR

Project Donors:
Caritas Germany Own Funds

Project Partner:
Yayasan Bumi Tangguh (YBT)


Project Title:
“Transitional shelter, sanitation and cash transfer for emergency affected households after earthquake and tsunami disaster in Central Sulawesi Island, Indonesia”

Project Number:
P.416-015/2018+P.416-019/2018

Project Period:
15.10.2018 – 30.09.2019

Overall Budget:
520.000 + 200.000 EUR

Project Donors:
Caritas Germany Own Funds (200.000) + German Federal Foreign Office (AA) (520.000)

Project Partner:
Cathlic Relief Services with PKPU and MDMC

2.       Background information and Context
a.       Background
Indonesia experienced severe earthquakes throughout 2018, amongst others in Lombok and Central Sulawesi. As a consequence of these natural disasters, many people living in the affected regions lost their homes – some of the houses got completely destroyed, others were severely or slightly damaged.

In response to that, Caritas Germany (CG) through its Country Office Indonesia (COI) started three projects with its partner organizations YBT, HFH, CRS (with MDMC & PKPU) in two regions in Central Sulawesi and one region in Lombok in order to provide temporary shelter as well as access to sanitation facilities to affected households. In cooperation with Caritas Germany and based on various external and internal issues, each partner developed their own strategy and their own activities to fulfill their mandate.

This is the first time that Caritas Germany works with these three partners.

Caritas Germany plans an extension of its shelter project with CRS in Central Sulawesi which is supposed to start in November 2019.

b.       Context:
Intended Objectives: All projects aim at providing beneficiaries with safe and healthy transitional shelters and access to sanitation facilities. Although not all projects include the construction of sanitation facilities, the partners agreed to make sure that the beneficiaries get access to sanitation in the project regions (either through getting funding for building latrines from another donor or by making sure another organization provides latrines). The disaster affected communities should also be trained how to build back safer (BBS) and be therefore better prepared for future disasters.

Target group: The beneficiaries of the projects are households that were affected by the earthquake in a way that their previous house was either damaged or completely destroyed. The three projects in total managed to build 1.330 transitional shelter and 575 latrines. 575 t-shelters from CRS (575 latrines), 290 from YBT (public communal latrines) and 465 from HFH (313 latrines financed by another donor).

Current Status: None of the projects could be finished within the initially planned timeframe, all three partners applied for a no cost extension (NCE). YBT was extended for 1 month, CRS for 3 months and HFH for 4 months.

-          YBT: The construction of t-shelters could already be finished on 31.05.19. However, YBT proposed for a NCE until September 2019 as they haven’t spent the entire budget. They will implement a waste management activity and build public latrines in Desa Jeringo since the community in Jeringo village does not have sufficient sanitation facilities.

-          HFH: Proposed a NCE until November 2019. Per July 2019, 174 t-shelters were built and occupied. 60 t-shelters are currently under construction and will be finished by the end of August 2019.

-          CRS: The project will be finished in September, so far construction of t-shelters has been finished, and construction of latrines is still ongoing..

Further details about the projects can be retrieved from proposals, reports, etc.

3.       Objective of the Evaluation
Objective: General reflection and overall evaluation of the Caritas Germany t-shelter projects

The overall objective of the evaluation is carried out to:

-          Reflect what should be improved by Caritas Germany and its partners

-          Document the lessons learnt from this projects

-          Compare the three different strategies and activities (including design of t-shelters & sanitation facilities)

-          Develop considerations for the planning and implementation of future t-shelter and WASH programs after major disasters in Indonesia

The evaluation results will be used within Caritas Germany Indonesia and shared with the partner organizations as well as Caritas Germany Head office.

4.       Scope of the Evaluation
-          Thematic Coverage: whole program

-          Time Period: whole program period

-          Geographical focus: all the regions covered by the project implementation should be analyzed during the evaluation process

-          Target group: the sample should include a wide range of groups, including vulnerable groups, e.g. PwDs, single and female headed households, elderly people

5.       Sub Research Questions
This evaluation seeks to compare the different projects regarding the following aspects:

-          Final construction inspection

o   Determine the degree of completion

o   Are people living in safe t-shelter and do they have access to safe and healthy sanitation facilities?

o   Check the construction dimensions/ assess the structure, stability, technical safety of the constructed facilities

o   Inform the residents of construction defects or possible risks

-          WASH: To what extent was the provision of drainage and sanitation facilities integrated in the t-shelter program?

-          Technical aspects:

o   In what way did the project implementation differ from the initial plan regarding drawings, material (BoQ)?

-          Location of the t-shelters: Are the t-shelters/ settlements following regulations of relevant authorities regarding hazard and risk assessments; are they at a safe distance from actual or potential threats?

-          Sphere: To what extend did the projects not meet the Sphere Standards?

-          Participatory Implementation:

o   In what way do the beneficiaries feel that they (individually or as part of the community) were involved in the design and/ or implementation of the t-shelter and latrine program?

-          Vulnerable Groups:

o   How did the programs take into account and support particularly vulnerable households (PwDs, female headed households, older persons)?

o   How did Caritas Germany’s partners strengthen the role of women and their involvement in the projects (e..g. in designing and construction)?

-          Cooperation with stakeholders: How/ to which extent were the interventions harmonized with other NGOs working in the same area/ with the local government bodies?

-          Beneficiary selection process: Were there other selection criteria than the damage of the houses? Did the financial situation of beneficiaries play a role?

-          Beneficiary Capacity Building: To what extent were local capacities developed or strengthened through the humanitarian interventions? (BBS, DRR, Hygiene Promotion)

-          Acceptance of the t-shelter and sanitation facilities in the communities: How satisfied are beneficiaries with the facilities?

-          Temporary vs. permanent solution:

o   Do the beneficiaries view the t-shelter as permanent or temporary houses?

o   Is it possible to safely enhance their existing t-shelters and sanitation facilities towards a permanent solution?

o   Are beneficiaries who got t-shelters still eligible to receive permanent houses from government programs?

-          Timeframe: What were the reasons for delayed response?

-          Cost:

o   Which one was the most cost-efficient program?

o   Composition of the budget of each partner (direct and indirect cost)

-          Construction process: Which one of the approaches to build the houses (manpower) was the most efficient and appropriate (setting up of working groups, paying incentives to groups, only distributing material, cash, etc.)?

-          Livelihood: How do the projects influence the local livelihood of the community? (sourcing local labor and materials, e.g. bricks, doors, sand)

6.       Approach and Methodology
The Evaluator is expected to perform the evaluation in a strictly methodical manner in order to produce verifiable information and make recommendations that are sufficiently valid and reliably based on dependable data and analysis, which are accessible to the client.

The evaluation will adopt a participatory, transparent and solution-oriented approach using internal and external stakeholders. The evaluation process, as well as the final results should be gender-sensitive and human-rights-based. The evaluator will use mix-methods that are able to appropriately address the primary evaluation questions, as well as properly support its derivative conclusion and recommendation.

The evaluation methods to be used may include, but are not limited to:

·       Review of project documentation (Desk Research): An array of major documents that should be studied (e.g. project documents, monitoring reports, final reports, as well as statistical data, documents pertaining to similar projects led by other donor organizations, etc.). Existing project documents and reports are to be shared with the evaluator in order to facilitate the realization of the tasks. The evaluator is invited to request additional documents that may be needed for the completion of the evaluation.

·       Interviews with all the key informants and key players: (semi-)structured Interviews with beneficiaries are a must and should be supported by interview protocols and the list of respondents (e.g. direct project beneficiaries, local stakeholders such as head of village, head of hamlet, BPBD, shelter cluster, local staff, etc.).

The selection criteria should be based on gender, age, beneficiaries/non-beneficiaries and geographical spread in the project region.

The exact sample size should be proposed by the evaluator and discussed with Caritas Germany before the start of the evaluation.

·       Direct observation during field visits: Caritas Germany in cooperation with HFH, YBT and CRS will organize field visits at different project sites..

·       Focus group discussion with beneficiaries, local leaders or local partner staff (if feasible within the timeframe).

·       Standardized Survey and questionnaires: to quantify the result and deliver a statistical analysis.

7.       Deliverables and Timeframe
           i.          Inception Report:

An inception report will be submitted by the evaluating consultant in order to demonstrate his understanding and planning of the evaluation, which will be reviewed and discussed with Caritas Germany.

The inception report should include an evaluation matrix[1] (including the final evaluation questions and indicators); the overall evaluation design and methodology with a detailed description of the data collection methods and data analysis techniques, as well as a proposed timeframe for the activities and deliverables. The evaluator is free to suggest additional methodological framework for the evaluation.

         ii.          Workshops/ Meeting:

The organization of any type of workshop or meeting (e.g. kick-off/mid-term/validation workshop) during the conduction of the evaluation has to be discussed between Caritas Germany and the evaluator.

The Kick-off workshop provides an opportunity to discuss organizational processes, methodology, data collection instruments, timetable, milestones, reporting dates, task and responsibilities. Moreover, the mid-term workshop is useful to discuss problems that may arise in the course of an evaluation and allow a joint development of strategies for solutions.

During a validation workshop, the evaluator will present the findings collected in the field to Caritas Germany. The workshop will be organized in order to discuss and validate findings, lessons learned and recommendations proposed by the evaluator. Stakeholders are invited to make recommendations for amending the review.

        iii.          Draft Report:

The consultant is expected to submit the primary findings resulting from his evaluation, as well as his initial recommendations to Caritas Germany. The Draft Report should be presented after the field work has been concluded, and should incorporate comments supplied by Caritas Germany and its partner organizations.

        iv.          Final Report:

The final report serves to illustrate the relevant evidence corresponding with the evaluation issues, questions and criteria listed in the Terms of Reference. The final report should provide an executive summary in English. The Final report should take all aspects reviewed during meetings that were held into consideration, and is subject to approval by Caritas Germany.

The proposed report; its length should be discussed with Caritas Germany. All documents and tools are to be written in English language.

8.       Timeframe for Deliverables
The timeline for the activities consists of the following phases:

Preparation Phase:

§  Analysis of relevant project documents, as well as further research

§  Preparation of inception report and exchange with HFH, YBT, CRS and Caritas Germany

§  Kick-off Meeting with Caritas Germany

Field Phase:

§  Briefing with HFH, YBT, CRS, Caritas Germany and other relevant actors in Central Sulawesi and Lombok

§  Field visits

§  Validation Meetings involving HFH, YBT, CRS and Caritas Germany individually

Synthesis Phase:

§   Reporting including management response workshop

§   Draft evaluation report

§   Produce final report including revision as per feedback

The key products expected for the evaluation are the following:


Deliverable

Inception Report
Dates 15.10.2019

Draft Report
Dates 15.11.2019

Final Report
Dates 30.11.2019

The evaluator should present a detailed work plan and timeframe of all activities including the relevant resource allocation (see Annex 3).

9.       Roles and Responsibilities
The evaluator is responsible for organizing and facilitating the logistics to and in the relevant project sites. HFH, YBT, CRS and Caritas Germany will provide access to all relevant project documents.

The evaluator will be working under and reporting to the Caritas Germany Country Office Indonesia during the evaluation phase.

10.   Guiding Principles & Donor concepts
The evaluator is to conduct the evaluation in accordance with the principles outlined in the “Caritas Internationalis management standards” document, the “Caritas Code of conduct”, as well as the “Guidelines on Combating Fraud and Corruption in the Project Work of Caritas Germany”.

The evaluator must take all required steps to ensure that the evaluation is designed and conducted to respect and protect the rights and welfare of the people and the communities of which they are members, as well as to ensure that the evaluation is technically accurate, reliable, and legitimate, and conducted in a transparent and impartial manner. Moreover, the evaluation should ideally contribute to organizational learning and accountability.

11.   Professional Qualification and Experience
Caritas Germany Country Office Indonesia seeks expression of interest from evaluation consultants/teams with the following skills/qualifications and expertise:

§  Minimum 8 years-experience in implementing temporary shelter programs (program design and technical/engineering focus) and in undertaking technical evaluation.

§  Minimum qualification of a master´s degree or equivalent combination of education and relevant work experience

§  Sound and proved experience in conducting evaluations preferable on temporary shelter issues, particularly utilization and learning focused evaluations

§  Understanding of project management structures

§  In-depth knowledge and experience in Temporary Shelter and Sanitation Projects

§  Knowledge of strategic and operational management of humanitarian operations, as well as proven ability to provide strategic and practical recommendation to key stakeholders Demonstrate understanding and sensitivity on cross-culture, tradition and language of project targets, especially in Lombok and Central Sulawesi

§  Strong analytical skills and ability to clearly synthesize and present findings, draw practical conclusions, make recommendations and prepare well-written reports in a timely manner

§  Experience in qualitative and/or quantitative data collection and data analysis techniques

§  Strong expertise in using participatory tools

§  Familiarity with transparency and downward accountability processes and their values

§  Able to travel and undertake data collection in Lombok and Central Sulawesi

§  Fluency in written and spoken Bahasa Indonesia and English.

§  Country and regional experience in Indonesia

12.   Terms of Payment
The evaluator is to receive payment from Caritas Germany in three instalments:

·       1st Payment: 30 % upon signing of the contract;

·       2nd Payment: 30 % upon the submission of the first draft of the evaluation report;

·       Final Payment: 40 % upon the submission of the final evaluation report, subject to its acceptance by Caritas

Caritas Germany will not settle any payment unless the consultancy institution accomplished all the tasks in a timely fashion. The basis for payment scheduling is to be determined during contract negotiations.

13.   Application Procedure
Interested candidates should submit their application material by 20.09.2019

The application itself should include the following components:

§  Curriculum Vitae (CV) including 3 professional references, and indication of daily rates

§  Cover letter transparently summarizing relevant experience in Temporary Shelter as well as practical experience in planning and conducting project evaluations

§  Track record of conducted studies, research, publication and references

§  A technical proposal for the evaluation, including the proposed evaluation methodology and work plan

§  Financial proposal[2] underlying the evaluation, including proposed fee

§  A sample of recent writing (report or similar) relevant to the terms of reference stated above

The proposal should be addressed to:

Ms. Ade Ferry 

Caritas Germany Country Office Indonesia

Perum Citra Nirwana Blok A No. 4

Jl. Kalimantan – Ring Road Utara

55284 Yogyakarta

Email: caritas.germany@gmail.com