In this paper ac describe and illustrate a procedure fr selecting items fro
m a large pool for a certification test. The proposed procedure, which is i
ntended to improve the alignment of the certification test with on-the-job
performance, is based on an expertise sensitive index, This index fur an it
em is the difference between the item's p values for experts and novices. A
n example is provided of thr application of the index for selecting items t
o Lr used in certifying bakers.