AGREEMENT AMONG AND WITHIN GROUPS OF PATHOLOGISTS IN THE CLASSIFICATION OF RHABDOMYOSARCOMA AND RELATED CHILDHOOD SARCOMAS - REPORT OF AN INTERNATIONAL STUDY OF 4 PATHOLOGY CLASSIFICATIONS

Background. An International Pathology study was conducted to measure the agreement demonstrated among and within groups of pathologists inv olved in the categorization of childhood rhabdomyosarcoma according to four pathology classifications. Data concerning agreement and surviva l experience according to patho- new subtypes were used as a basis for selection of a proposed new pathologic classification. Methods. A ran dom sample of 800 eligible patients was chosen from the Intergroup Rha bdomyosarcoma Study II (IRS-II) and was reviewed by pathologists repre senting eight institutions, A 20% sample of the 800 patients was then rereviewed by the pathologists to determine the level of agreement wit h their original classification. In each instance the patients were cl assified according to four pathology systems: the conventional system, the International Society for Pediatric Oncology system (SIOP), the N ational Cancer Institute (NCI) system,and the cytohistologic system. R esults. Among the groups of pathologists, the highest measure of agree ment was a Kappa value of K = 0.451 for the conventional system, follo wed by K = 0.406 for the SIOP system, K = 0.384 for the NCI system, an d K = 0.328 for the cytohistologic system. For reproducibility within the groups of pathologists, the highest measure of agreement was K = 0 .605 for the conventional system, followed by K = 0.579 for the NCI sy stem, K = 0.573 for the SIOP system, and K = 0.508 for the cytohistolo gic system. Conclusions. There was a general similarity between the ag reement reached within the modified conventional, SIOP, and NCI system s, with the modified conventional system having the highest Kappa valu es, and thus the highest measure of agreement, both among and within t he groups of pathologists. Also, the subtypes of the conventional syst em demonstrated a highly significant relationship to survival time. He nce, based on criteria of reproducibility and prognostic significance, the proposed classification will essentially be a modification of the conventional system with elements of the SIOP and NCI systems.