11 Implementation Evaluation & Learning

Question 1

What is implementation evaluation?

Answer 1

The systematic assessment of how an intervention is delivered, used, and sustained.

Focuses on process and use; distinct from impact evaluation.

Question 2

Why is implementation evaluation different from performance monitoring?

Answer 2

Because its purpose is learning, not accountability.

Explains variation and supports adaptation.

Question 3

What is the primary purpose of implementation evaluation?

Answer 3

To inform course correction during implementation.

Real-time learning and design refinement.

Question 4

What does formative evaluation mean?

Answer 4

Evaluation conducted to improve implementation while it is ongoing.

Early and iterative; prevents late surprises.

Question 5

What does summative evaluation mean?

Answer 5

Evaluation conducted to judge overall success after implementation.

Retrospective and outcome-focused; too late to fix design.

Question 6

Why is formative evaluation especially important in implementation?

Answer 6

Because systems adapt as you intervene.

Drift occurs and workarounds emerge.

Question 7

What question should evaluation answer early on?

Answer 7

“Is this being used as intended?”

Focus on adoption, fidelity, and acceptability.

Question 8

Why is “Did it work?” the wrong early evaluation question?

Answer 8

Because effects depend on implementation quality.

No use → no effect; poor use → misleading effect.

Question 9

What makes evaluation actionable?

Answer 9

Clear linkage between findings and decisions.

If no decision follows, evaluation failed.

Question 10

Why do dashboards often fail implementation teams?

Answer 10

Because they show numbers without interpretation.

No causal story and no phase awareness.

Question 11

What role does qualitative data play in evaluation?

Answer 11

It explains why quantitative patterns occur.

Reveals mechanisms and surfaces hidden costs.

Question 12

Why is mixed-methods evaluation powerful?

Answer 12

Because numbers and narratives answer different questions.

Quant = what and how much; Qual = why and how.

Question 13

What is a common evaluation mistake early in implementation?

Answer 13

Measuring distal outcomes too soon.

Lagging indicators and confounded results.

Question 14

How should evaluation change across phases?

Answer 14

Focus shifts as implementation matures.

Early: adoption and feasibility; Mid: fidelity and acceptability; Late: sustainment.

Question 15

Why is evaluation inseparable from Theory of Change?

Answer 15

Because evaluation tests causal assumptions.

Which links hold and which links break.

Question 16

What does “learning orientation” mean in evaluation?

Answer 16

Treating data as guidance, not judgement.

Curiosity over blame; adaptation over defence.

Question 17

Why do teams hide or downplay negative findings?

Answer 17

Because evaluation is tied to performance judgement.

Reputation risk and funding pressure.

Question 18

How does evaluation support adaptation decisions?

Answer 18

By identifying where friction concentrates.

Drop-off points and drift indicators.

Question 19

What is the danger of over-measurement?

Answer 19

Measurement burden that slows implementation.

Data collection fatigue and reduced goodwill.

Question 20

Why is evaluation timing as important as what you measure?

Answer 20

Because systems change over time.

Early volatility and later stabilisation.

Question 21

What is “evaluation drift”?

Answer 21

When measures lose relevance as implementation evolves.

Old questions and new realities.

Question 22

How can evaluation unintentionally distort behaviour?

Answer 22

By incentivising metric optimisation over real improvement.

Gaming and surface compliance.

Question 23

Why should evaluation findings be shared quickly?

Answer 23

Because delayed feedback reduces learning value.

Fast loops and timely adjustment.

Question 24

What does “closing the loop” in evaluation mean?

Answer 24

Acting on findings and checking effects.

Decision → change → reassessment.

Question 25

Why is evaluation critical for **sustainment**?

Answer 25

Because drift and decay are gradual. ## Footnote Early warning signals and maintenance triggers.

Question 26

How does evaluation support **scale-up**?

Answer 26

By revealing which elements travel well and which don’t. ## Footnote Core robustness and context sensitivity.

Question 27

What evaluation mindset supports **OHFE credibility**?

Answer 27

Non-defensive, system-focused inquiry. ## Footnote Avoids blame and enables redesign.

Question 28

Why is evaluation often resisted by **frontline staff**?

Answer 28

Because it is experienced as surveillance. ## Footnote Past misuse and punitive culture.

Question 29

What signals healthy implementation **learning**?

Answer 29

Regular adjustments based on evidence. ## Footnote Changing strategies and revising assumptions.

Question 30

In one line, what is **implementation evaluation** for practitioners?

Answer 30

A disciplined way to learn whether change is working—and how to make it work better. ## Footnote Focuses on continuous improvement.