This article describes a study evaluating the Consumer Assessment of Behavi
oral Health Survey (CABHS) and the Mental Health Statistics Improvement Pro
gram (MHSIP) surveys. The purpose of the study was to provide data that cou
ld be used to develop recommendations for an improved instrument. Subjects
were 3,443 adults in six behavioral health plans. The surveys did not diffe
r significantly in response rate or consumer burden. Both surveys reliably
assessed access to treatment and aspects of appropriateness and quality. Th
e CABHS survey reliably assessed features of the insurance plan; the MHSIP
survey reliably assessed treatment outcome. Analyses of comparable items su
ggested which survey items had greater validity. Results are discussed in t
erms of consistency with earlier research using these and other consumer su
rveys. Implications and recommendations for survey development, quality imp
rovement, and national policy initiatives to evaluate health plan performan
ce are presented.