Jordan - Water Smart Homes
| Reference ID | DDI-MCC-JOR-SI-WSH-2019-v2.0 |
| Year | 2014 |
| Country | Jordan |
| Producer(s) |
Social Impact, Inc. - Private Company Jeuland, Marc - Duke University |
| Sponsor(s) | Millennium Challenge Corporation - MCC - |
| Metadata |
 Documentation in PDF
|
| Created on | Apr 02, 2019 |
| Last modified | Apr 20, 2020 |
| Page views | 2702 |
| Downloads | 768 |
Overview
Identification
ID Number DDI-MCC-JOR-SI-WSH-2019-v2.0 |
Version
Version Description
- v02: Anonymized dataset for public distributionOverview
Abstract
Activity 1: Outreach CampaignThe evaluation for the Water Smart Homes Outreach Campaign is an ex-post design, using different methods for respondents from the household survey sample versus households from the NAF beneficiary survey sample. For the household sample, the evaluation is an impact evaluation using a difference-in-difference (DiD) panel analysis. For the NAF sample, the evaluation is a cross-sectional impact evaluation using post-intervention means comparisons and multivariable regression (controlling for potential household confounders) of outcomes across treated and untreated households with NAF beneficiaries. The evaluation question is, Did the WSH messaging campaign lead to significant changes in household water handling and storage, that manifested in a) improved water potability and b) improved water efficiency at the household level? The Outreach Campaign was implemented between September 2015 and August 2016.
Activity 2: Direct Assistance Program
The evaluation of the WSH-ISW program is a cross-sectional impact evaluation using post-intervention means comparisons and multivariable regression (controlling for potential household confounders) of outcomes across treated and untreated NAF households. There are two evaluation questions for this activity: 1) Did the WSH activity lead to infrastructure improvements among NAF beneficiaries? and 2) Did NAF beneficiaries experience economic benefits from these infrastructure and behavioral changes, specifically through reduced coping costs, increased household productivity, and/or improved health and well-being? The WSH-ISW program was implemented between April 2015 and August 2016.
Activity 3: Women Plumbers Program
The evaluation of the Women Plumbers Program is an ex-post performance evaluation using qualitative methods. The evaluation question is, Did the plumbers training portion of the WSH intervention lead to long term capacity and employment opportunities for the women who participated? The training took place from March to April 2015.
Evaluation Methodology
Ex-PostUnits of Analysis
Activity 1: Outreach Campaign - households Activity 2: Direct Assistance Program - households
Activity 3: Women Plumbers Program - individuals
Kind of Data
Sample survey data [ssd]Questionnaires
Activity 1: Outreach Campaign The survey questions for the Outreach Campaign are included within the seasonal 2 backcheck survey, endline household survey, and semi-quantitative NAF instrument (described under Activity 2). Other than the module on message recall, these sureys include household demographics, water subscriber information and billing, water sources, a household roster, water-borne diseases, sanitation and hygeine, and income and consumption.
Activity 2: Direct Assistance Program
The questionnaire for the WSH-ISW program was semi-quantitative, including mostly quantitative questions similar to the household survey, and a brief qualitative section specific to WSH-ISW. This semi-quantitative NAF instrument included sections on household demographics, water subscriber information and billing, water sources, a household roster, water-borne diseases, sanitation and hygeine, income and consumption, infrastructure observation, and perceptions of the WSH-ISW program.
Activity 3: Women Plumbers Program
The qualitative interview guides for the WPP were designed to be mostly qualitative, but include some quantitative questions. The topics covered by the qualitative portion of the instrument include career trajectory, motivation for participation in the WPP, skills gained from the WPP, and overall perceptions of the program. Quantitative questions include income, a self-assessment of skills, career, participation in similar training programs, and monthly customers/plumbing jobs.
Geographic Coverage
NAF Survey, Women Plumbers Interviews - Zarqa Governorate Household Survey - Zarqa Governorate and East Amman
Topics
| Topic | Vocabulary | URI |
|---|---|---|
| Water, Sanitation & Hygiene | MCC Sector |
Keywords
Urban water system, Impact evaluation, Mixed methods, Performance evaluation, Water Conservation, Household water use, Vocational training, Behavior changeProducers and Sponsors
Primary Investigator(s)
| Name | Affiliation |
|---|---|
| Social Impact, Inc. | Private Company |
| Jeuland, Marc | Duke University |
Other Producer(s)
| Name | Affiliation | Role |
|---|---|---|
| Ipsos | Private Company | Original producer |
| Social Impact, Inc. | Private Company | Oversight |
Funding
| Name | Abbreviation | Role |
|---|---|---|
| Millennium Challenge Corporation | MCC |
Metadata Production
Metadata Produced By
| Name | Abbreviation | Role |
|---|---|---|
| Millennium Challenge Corporation | MCC | Review of Metadata |
Date Produced
2019-10-07Metadata Version
Version 2.0 (December 2019) Anonymized datasets for public distributionMetadata ID Number
DDI-MCC-JOR-SI-WSH-2019-v2.0MCC Compact and Program
Compact or Threshold
Jordan CompactProgram
The Water Smart Homes (WSH) evaluation is intended to explore the three activities under the WSH program: · Activity 1: Outreach campaign · Activity 2: Direct assistance program · Activity 3: Women plumbers program Throughout this Evaluation Design Report (EDR), we reference the Impact Evaluation Design Report prepared by Social Impact for the evaluation of the Millennium Challenge Corporation's (MCC) five-year Compact with the Government of Jordan (GOJ). At the time of approval of the Compact EDR, there was insufficient information about the Water Smart Homes Activity to produce an evaluation design. It was determined then that an evaluation component could be proposed at a later date, but that the scope of this evaluation would have to be commensurate with the small scale of the investment relative to the main infrastructures. This document expands on the approach to the Water Smart Homes evaluation detailed in Annex F of the Compact EDR.MCC Sector
Water, Sanitation and Hygiene (WASH)Program Logic
The economic logic of the Compact was predicated on an increase in the effective supply of water through two primary sources. First, reductions in urban water losses would directly increase the amount of water that reaches end users of the water network, as well as its duration (or reliability of service). As more water would become available through the network on a more continuous basis, households and businesses would reduce their consumption of more expensive alternatives, namely tanker water and treated shop water. This benefit stream is referred to as the Secondary Substitution Effect. Second, increased collection and treatment of urban wastewater would generate additional supplies of high-quality treated water for irrigated agriculture in the Jordan Valley. When this treated wastewater is substituted for surface water, equivalent supplies of freshwater would be diverted to higher value uses in the urban areas of Amman and Zarqa governorates where fresh water has the greatest economic benefit. This benefit stream is referred to as the Primary Substitution Effect in this report. A Compact-level program logic model is presented in the final report, which represents the relationship between projects, intermediate outputs, and final outcomes.Program Participants
Activity 1: Outreach Campaign - The primary audience for the Outreach Campaign was household decision makers on in-home water management in Zarqa, mainly but not exclusively women. The secondary audience was mainly comprised of male and female elementary school children in Zarqa. Activity 2: Direct Assistance Program - Recipients of the WSH-ISW program were selected from a survey of roughly 11,000 NAF beneficiaries living in Zarqa governorate. Based on the results of these surveys, 5,198 households were deemed eligible for infrastructure support, and were ranked in priority based on a composite eligibility score that included factors related to baseline infrastructure conditions, land tenure, and household socio-economic variables. In the end, 3,958 of NAF households benefited from the improvements. Activity 3: Women Plumbers Program - The target population for the WPP was women between the ages 25 and 40 with a minimum level of education of 9th grade. Participants were required to clear a security and health screening and report family acceptance of their participation in the program. Thirty women received the training.