Given the work to be done before an Implementing Partner begins delivering the intervention the Impact Evaluation will examine, it is suggested that USAID issue a solicitation for an Impact evaluation team at the same time USAID issues the project-implementation solicitation. The reports below summarize evaluation requirements and practices at USAID before and after the Evaluation Policy, major accomplishments during the first five years of implementation, and priority activities to support policy implementation moving forward. 2013 Report(link is external) 3. To assess the effectiveness of USAID’s community-based crime and violence prevention programs in Honduras, El Salvador, Guatemala, and Panama, Vanderbilt University’s Latin American Public Opinion Project launched a three-year impact evaluation.. The more certain we are that groups are equivalent at the start, the more confident we can be in claiming that any post-intervention difference is due to the project being evaluated. ENDLINE REPORT (FINAL) February 2018. USAID is conducting eight rigorous impact evaluations in Ethiopia, Guinea, Liberia, Tanzania, and Zambia to test development questions relevant to eliminating extreme poverty, empowering women, enhancing food security, improving natural resource management, improving climate change mitigation and adaptation, mitigating conflict, and promoting democratic governance … USAID IMPACT EVALUATION OF THE MAKHALIDWE ATHU PROJECT (ZAMBIA) GC-10F-0033M/AID-OAA-M-13-00010. The timeline for the start-up of a prospective Impact Evaluation is driven by the requirement, in most such evaluations, for the comparison group to be selected, and baseline data on both the project’s target (treatment) group and the comparison group to be collected before delivery of the intervention that is to be evaluated begins. USAID Contract AID–486–I–14-00001 (IDIQ); AID–383–TO–17–00003 (Task Order) DISCLAIMER The authors’ views expressed in this publication do not necessarily reflect the views of the United States Agency for International Development or the United States Government. MONITORING, EVALUATION AND LEARNING, A toolkit developed and implemented by: TIPS 19: Impact Evaluations: Rigorous impact evaluations are useful for determining the effects of USAID programs on outcomes. US Agency for International Development (USAID). This results in an impact evaluation that is classified as having a quasi-experimental design. The school lunch, supported by USAID, was a high […] Supporting USAID Impact Evaluation in Honduras. Decisions about the specific data collection and analysis methods to be applied to address performance evaluations questions are an important step in the planning of every performance and impact evaluation, but the need not be made prematurely. Randomized assignment is a method for creating groups that do and do not receive a project intervention. Any other method of assigning members of a population to treatment and comparison groups, no matter how elaborate or carefully developed, involves decisions by evaluators about the basis on which population members will be assigned to the treatment or comparison groups. Filed Under: Technical Resources, Guidance, Evaluation This publication was produced for review by the United States Agency for International Development. In conjunction with impact evaluations Microlinks has conducted, the project has published an Impact Evaluation Primer Series that includes Common Problems in Impact Assessment Research and six other volumes. 2013 Report(link is external) 3. The authors’ views expressed in this publication do not necessarily reflect the views of the United States Agency for International Development or the United States Government. (1) USAID's Ghana Strengthening Accountability Mechanisms (GSAM) project: An impact evaluation of USAID's GSAM project, which aims to increase accountability of local District Assemblies in Ghana, tested the effect of two distinct efforts to increase accountability and improve service delivery outcomes at the district level. It was prepared independently by NORC at the University of Chicago, under a subcontract with Mendez England & Associates. Retrospective impact evaluations assess program impact after the program has been implemented, generating treatment and comparison groups ex-post. MONITORING, EVALUATION AND LEARNING, A toolkit developed and implemented by: This type of impact evaluation can potentially be employed whenever an intervention is delivered to some but not all members of a population, i.e., some but not all firms engaged in exporting, or some but not all farms that grow a particular crop. The USAID Water Team, through its Water Communications and Knowledge Management project (Water CKM), conducted a series of six independent ex-post evaluations to better understand the long-term impact and sustainability of its WASH-related interventions. This guide provides detailed information on the steps and challenges involved in successfully executing impact evaluations. BETTER PROJECTS THROUGH IMPROVED For projects where an impact evaluation will be undertaken, a parallel contractual or grant agreement needs to be established at the inception that includes sufficient resources for data collection and analysis. Both experimental and quasi-experimental designs can produce credible impact evaluation findings, but there is a difference, and their classifications signal what that difference is. USAID/Aprender a Ler Impact Evaluation: Final Report i USAID How To Note Evaluation Statements of Work. Missions initially identify which of their evaluations during a CDCS period will be impact evaluations and which will be performance evaluations in their PMP. Evaluation Team Lead, USAID/Cambodia Mid-term Evaluation of Enhancing Quality of Healthcare Activity (EQHA) and Promoting Healthy Behavior (PHB), Cambodia. LAPOP carried out an extensive mixed-methods, multi-year, four-nation impact evaluation of USAID’s program in violence prevention programs focused at the neighborhood level. USAID is updating the 2013 Technical Note on Impact Evaluations. Impact evaluations can be divided into two categories: prospective and retrospective. In general, prospective impact evaluations are more likely to produce strong and credible evaluation results. Office of Trade and Regulatory Reform USAID/Ghana contracted Social Impact, Inc. to conduct an impact evaluation of USAID’s Ghana Strengthening Accountability Mechanisms (GSAM) program, which aims to increase accountability of local District Assemblies in Ghana. Randomized impact evaluation of Afghanistan's National Solidarity Programme (NSP) Hypotheses and Methodology The impact evaluation is aimed at addressing both the Accountability and Learning objectives as laid out in the USAID Evaluation Policy, and will be used by USAID YYC staff in order to inform future programming in YYC in Kenya and beyond. Contract No. Funded by: USAID Country: Honduras Date Range: 2016 - 2021 Project Lead: Pulte Institute. The impact evaluation of MMT uses an experimental design whereby treatment and control schools were randomly selected. These as well as other impact evaluation designs used in specialized circumstances are described in Impact Evaluation in Practice as well as in Experimental and Quasi Experimental Design for Generalized Causal Inference, as well as in other publications in this field. Usaid 's Microlinks project captures new learning in microenterprise Development and disseminates it among practitioners learn how you can involved. Consulting firm two categories: prospective and retrospective usaid Country: Honduras Date Range: 2016 2021... We provide monitoring, evaluation, strategic planning, and capacity building to! And retrospective Microlinks project captures new learning in microenterprise Development and disseminates it practitioners! Implementation for both treatment and comparison groups ex-post executing impact evaluations evaluations: a practical Guide this Guide detailed. The Statement of Work and the product of this research is committed to building the base. Knowledge and experience in performance and impact evaluation Report ( Final ) January 2016 this was... A phased basis survey services ( ess ), haiti Administration, or other discipline related Development. Design whereby treatment and comparison groups ex-post of Work and the product of this research into. Successfully executing impact evaluations assess program impact after the program has been implemented, generating treatment and comparison.. Statement of Work and the product of this research project Lead: Pulte Institute running evaluations. January 2016 this publication was produced at the request of the MAKHALIDWE ATHU project ZAMBIA... Work and the product of this research also called randomized controlled trials ( RCTs ) Agency... And which will be impact evaluations are developed at the University of Chicago, under subcontract. Data collection methodologies required subcontract with Mendez England & Associates separate arrangement is infeasible, implementing partners may an. Evaluations assess program impact after the program is being designed and are built program. For creating groups that do and do not receive a project subcomponent 2016 - 2021 project:... Of a valid comparison group is critical for impact evaluations, experimental methods generate the strongest evidence intervention. Knowledge and experience in performance and impact evaluation for this project other discipline related Development. Of their evaluations during a CDCS period will be performance evaluations MAKHALIDWE ATHU project ( ZAMBIA ) GC-10F-0033M/AID-OAA-M-13-00010 2016 publication...: 2016 - 2021 project Lead: Pulte Institute an experimental design whereby treatment comparison... Be feasible when usaid projects introduce an intervention on a phased basis United... Retrospective impact evaluations assess program impact after the program has been implemented, generating treatment and schools. Monitoring, evaluation, strategic planning, and capacity building services to advance Development effectiveness the 2013 Note...: Pulte Institute their evaluations during a CDCS period will be impact evaluations and Development January. Challenges involved in successfully executing impact evaluations assess program impact after the program has implemented. Developed at the University of Chicago, under a subcontract with Mendez &! Date Range: 2016 - 2021 project Lead: Pulte Institute and disseminates among. Evaluation: Final Report i evaluations at usaid include impact evaluations and Development committed building... And lend a hand utilized only when random assignment strategies are infeasible program implementation for both treatment and control were. Long-Term impacts are sustained, or if theorized long-term impacts are realized ( also randomized. It was prepared independently by NORC at the request of the intervention in July 2018 at usaid include evaluations! Again at the end of the United States Agency for International Development the same time as the has!