The criterion-related validity of a personality scale depends upon both log
ical and judgmental factors. Degree of logical implication between individu
al scales and criterion behaviours was assessed in terms of independently m
easured conceptual concordance, which was shown to be strongly associated w
ith measured validity in a sample of managers. It is thus essential to cont
rol for conceptual concordance when examining Ether possible moderators of
validity. In respect of judgmental moderators, behavioural criteria rated a
s more observable were found to yield significantly greater validity than l
ess observable behaviours, and conceptual concordance and criterion observa
bility were shown to interact to determine validity. Gender differences in
judgments were also found: validity of a personality scale was significantl
y greater when criterion-ratings were provided by male managers of male sub
ordinates than when male managers judged female subordinates. It is importa
nt to cite validity coefficients within specified boundary conditions, in r
espect of both conceptual concordance and judgmental attributes.