What do I use
Agencies, NGOs and programme evaluation
Baseline and endline surveys, monitoring and evaluation, donor reporting, impact assessment.
Your question, and what answers it
Or the paired test for the same people twice. The hard part is not the test, it is whether the comparison group is comparable.
In ZStat: open your study, go to Analysis, and choose independent t.
Matching on measured characteristics, with the balance table that shows whether it worked - and the standing caveat that it cannot balance what you did not measure.
In ZStat: open your study, go to Analysis, and choose propensity matching.
A proportion with an interval, and with your sampling weights applied.
In ZStat: open your study, go to Analysis, and choose survey proportion.
Yes. Ignoring the design understates every standard error, which makes a programme look more certainly effective than the data supports.
In ZStat: open your study, go to Analysis, and choose survey mean.
Hot spots, for targeting - with the warning that one test is run per location.
In ZStat: open your study, go to Analysis, and choose getis ord.
Usually yes, and it changes every conclusion about precision.
In ZStat: open your study, go to Analysis, and choose multilevel mixed.
The people who did not respond are usually the ones the programme was for.
In ZStat: open your study, go to Analysis, and choose missing pattern.
What goes wrong in agencies, ngos and programme evaluation
- Reporting a before-and-after difference as programme impact when anything else changed in the same period.
- Weighted survey data analysed as if it were a simple random sample.
- A results framework where every indicator improved. That is a sign of measurement, not of success.