Assessing Developmental Evaluation Across 3 USAID Missions
Programs in complex settings or with untested theories of change often face the challenge of using traditional mid-term or end-term evaluations to assess their impact. In such programs, traditional evaluations can occur too late and/or measure pre-defined outcomes. To help address this issue, the Developmental Evaluation Pilot Activity (DEPA-MERL) mechanism was launched under the Monitoring, Evaluation, Research and Learning Innovations Program (MERLIN) to test the effectiveness of a developmental evaluation (DE) approach in measuring impact of USAID programs that are characterized by innovative interventions, untested theories of change, and/or implementation in complex contexts. DEPA-MERL is funded by the USAID Global Development Lab. Organizations forming the DEPA-MERL consortium are Social Impact (prime), Search for Common Ground, and The William Davidson Institute at the University of Michigan.
WDI’s role in the consortium is to facilitate learning on the implementation of the DE methodology in the context of USAID programming. WDI and the DEPA-MERL consortium seek to answer the following three research questions for each DE technical assistance pilot in order to assess the value of DE and enable comparison across the pilots in which the DE are implemented,:
- Research Question 1: In what ways is the DE approach, as implemented across the various projects, able to capture and promote use of emergent learnings in support of ongoing development of programming in a complex system in the USAID context, i.e. does the DE allow for rapid learning and adaptive management?
- Research Question 2: What are the barriers and enablers to implementation of the DE approach in the USAID context? How does the DE vary depending on the USAID context?
- Research Question 3: What are key informants’ perceived value added or lost (for example: time, utility, monetary costs, scale-up decisions) of conducting a DE versus a traditional evaluation approach in a complex setting at USAID?