Sc. Vaughan et al., THE DEFINITION AND ASSESSMENT OF ANALYTIC PROCESS - CAN ANALYSTS AGREE, International Journal of Psycho-analysis, 78, 1997, pp. 959-973
Although analytic process (AP) is a core concept in psychoanalytic the
ory and practice and has emerged as an important variable in outcome s
tudies, there is no consensus regarding its definition and operational
isation. This paper describes the development and validation of the Co
lumbia Analytic Process Scale (CAPS), a rating scale developed to eval
uate the presence or absence of AP in a single psychoanalytic session
transcript for purposes of an outcome study Definitions of interrater
reliability and construct validity are reviewed and two studies design
ed to evaluate these important aspects of the CAPS are presented. The
results demonstrate that the CAPS has adequate interrater reliability
(kappa = .5). To establish construct validity the plan was to compare
the CAPS rating of AP to clinical consensus. However, wizen a group of
ten senior training and supervising analysts at Columbia were asked t
o rate five psychoanalytic session transcripts, no clinical consensus
could be established. Statistical analysis of the pattern of the analy
sts' clinical ratings showed that the largest portion of the variance
was accounted for by the error term of a two-way ANOVA. The implicatio
n of this finding is that the construct of AP itself is ill-defined Th
e results of this study suggest that the commonly used term AP has les
s consensually held meanings than analysts tend to believe; the impact
of lack of definition of key terms on clinical and research pursuits
within psychoanalysis is discussed.