Graphical modeling: A new response type for measuring the qualitative component of mathematical reasoning

We investigated the functioning of a new computer-delivered response type f or potential use in graduate admissions assessment. This response type, whi ch is open-ended and automatically scorable, presents problems calling for the examinee to draw a graph modeling a given situation. Problem situations can be like the single-best-answer items currently found on the Graduate R ecord Examinations (GRE) General Test(ETS, 1998) or they can be more loosel y defined, allowing for multiple-correct responses. Two graphical modeling (GM) tests differing from one another in the manipulation of specific item features were randomly spiraled among study participants. Results showed th at GM scores were very reliable and moderately related to the General Test' s quantitative section, suggesting that GM might help broaden the GRE quant itative construct. In exploratory difficulty analyses, 1 of 3 manipulated i tem features, problem structure, had a dependable effect. No significant ge nder differences independent of those associated with the GRE quantitative section were detected. Finally, more participants preferred regular multipl e-choice graphical reasoning questions to GM items but thought GM was the f airer indicator of their ability to undertake graduate study.