Using cluster random assignment to measure program impacts - Statistical implications for the evaluation of education programs

Citation
Hs. Bloom et al., Using cluster random assignment to measure program impacts - Statistical implications for the evaluation of education programs, EVAL REV, 23(4), 1999, pp. 445-469
Citations number
20
Categorie Soggetti
Social Work & Social Policy
Journal title
EVALUATION REVIEW
ISSN journal
0193841X → ACNP
Volume
23
Issue
4
Year of publication
1999
Pages
445 - 469
Database
ISI
SICI code
0193-841X(199908)23:4<445:UCRATM>2.0.ZU;2-A
Abstract
This article explores the possibility of randomly assigning groups (or clus ters) of individuals to a program or a control group to estimate the impact s of programs designed to affect whole groups. This cluster assignment appr oach maintains the primary strength of random assignment-the provision of u nbiased impact estimates-but has less statistical power than random assignm ent of individuals, which usually is not possible for programs focused on w hole groups. To explore the statistical implications of cluster assignment, the authors (a) outline the issues involved, (b) present an analytic frame work for studying these issues, and (c) apply this framework to assess the potential for using the approach to evaluate education programs targeted on whole schools. The findings suggest that cluster assignment of schools hol ds some promise for estimating the impacts of education programs when it is possible to control for the average performance of past student cohorts or the past performance of individual students.