Generalizing physical ability test validity: A case study using test transportability, validity generalization, and construct-related validation evidence
Cc. Hoffman, Generalizing physical ability test validity: A case study using test transportability, validity generalization, and construct-related validation evidence, PERS PSYCH, 52(4), 1999, pp. 1019-1041
This paper describes a field study using Position Analysis Questionnaire (P
AQ; McCormick, Jeanneret, & Mecham, 1972) data to support inferences of phy
sical ability test (PAT) validity at a large utility company. The project d
eveloped a test transportability procedure using worker-oriented job analys
is, and was based on synthesizing the findings of an earlier consortium pro
ject (American Gas Association, 1990), recent validity generalization evide
nce, and findings from a variety of physical ability construct-related rese
arch projects published or presented since the completion of the original c
onsortium study. Selected PAQ divisional dimension scores for 95 jobs were
analyzed via cluster analysis to develop five physical demand job families.
Statistically derived job families were modified very slightly based on re
views by subject matter experts who found PAQ-derived job family structures
quite reasonable (agreement of 95% between statistical and rational proced
ures). PAQ strength attributes were used to estimate the physical demands u
nderlying job families. The statistical and analytic procedures developed a
nd reported here could be applied in other organizational settings, and all
ow broader applicability of the PAT than would a task-based transportabilit
y model.