Most ICAP publications are available online, and many have been translated in part or in full into several languages.

3. Undertaking Evaluations

Policy Tools  Toolkits  Evaluation Toolkit  3. Undertaking Evaluations

Most well-designed programs include provisions for evaluation from the very outset. Data collection, feedback, and measurement of impact and outcomes are built in. 

 

TABLE 1 demonstrates how an evaluation can be integrated into the program’s structure, listing the decisions and steps that must be made before, during, and after an intervention. 

 

TABLE 1. Key Steps for Evaluating An intervention

Before the Intervention

 

Planning an Evaluation

·         Identify the purpose of evaluation.

·         Determine the appropriate approach to evaluation, depending on its purpose and available resources.

·         Clearly define resources available and resources needed. This will determine whether evaluation will be conducted internally or by external experts, as well as its duration and follow-up.

·         Develop evaluation methodology by identifying:

o        Target group(s) for evaluation results

o        Parameters for data collection (e.g., sample size, timeline for data collection and follow-up)

o        Appropriate questions

 

Data Collection

·         Gather baseline data for future comparison (in outcomes- and impact-based evaluations).

 

During the Intervention

 

Data Collection (continued)

·         Track how widely materials have been distributed and assess expenditure of time and resources.

·         Gather information about intervention recipients.

 

After the Intervention

 

Data Collection (continued)

·         Conduct post-intervention data collection to compare with baseline.

·         Where appropriate, conduct a second wave of data collection at a later point to assess whether intervention effects persist over time and whether changes can be sustained.

 

Data Analysis and Interpretation

·         Analyze data and compare with baseline.

·         Interpret evaluation findings.

·         Identify implications of findings.

·         Report and disseminate evaluation findings.

 

 

Three key stages of conducting an evaluation are worth discussing in detail:

 

3.1    Who Should Evaluate?

 

3.2   Planning an Evaluation

 

3.3   Data Collection