Objective. To assess guidelines, set by the National Committee for Quality
Assurance, for the Health Plan Employer Data and Information Set (HEDIS) 19
99 CAMPS 2.0H Survey (formerly the HEDIS 1999 Consumer Survey) in the light
of user's needs to monitor health plan performance over time, monitor sick
enrollees, and prioritize determinants (drivers) of enrollee experience.
Design. A two-wave, cross-sectional/longitudinal panel design, consisting o
f national surveys mailed to employees of three major USA corporations in 1
993 and 1995.
Study participants. Samples included employees selected to represent 23 maj
or managed care and indemnity plans in bye regions of the USA. In 1993, 14
587 employees responded and in 1995 9018 employees responded (response rate
s: 51 and 52%). The longitudinal panel sample included 5729 employees who c
ompleted both surveys and stayed in the same plan for both years.
Study measures. The main 1993 and 1995 surveys consisted of 154 and 116 ite
ms, respectively. Panel survey content assessed care delivery, plan adminis
tration, functional status, well being, and chronic disease.
Results. CAHPS 2.0H's point-in-time, cross-sectional design was unable to d
etect selection bias and led to an inaccurate view of change in performance
. CAMPS 2.0H's use of aggregate samples masked key differences between heal
thy and sick enrollees; e.g. the sick became less satisfied over time. The
association-based statistical techniques that many survey users will employ
to prioritize the 'drivers' of enrollee experience in the absence of CAMPS
2.0H guidelines yielded a less efficient account of change than the multi-
method/multi-trait approach developed for this project.
Conclusion. Consumer experience of plan performance is best understood when
the separate contributions oi longitudinal membership and movement in and
out of plans are clarified, changes in health are identified, changes for s
ick and healthy enrollees are compared, and plan performance on satisfactio
n criteria is probed to give confirmation and detail. Changes to the CAHPS
2.0H approach in HEDIS 1999 will facilitate user application of these princ
iples.