Medical students' confidence judgments using a factual database and personal memory: A comparison

In order to determine whether medical students can recognize when an inform ation need has been fulfilled and when it has not, this study examined the quality of medical students' confidence estimates in answering short-answer questions dealing with bacteriology, based upon their personal knowledge a lone and what they were able to retrieve from a factual database in microbi ology. Twelve students, assessed over three occasions, remained in the fina l sample. The results indicate that students displayed a positive relations hip between their expertise in answering the questions and the amount of ov erconfidence they indicated (the opposite of the hard-easy effect) for the personal knowledge task using a partial credit format. For the database-ass isted task using the partial credit format, students showed less overconfid ence in their answers with greater expertise in using the database. For bot h the personal knowledge and database-assisted tasks using a binary format (all or nothing correct), the students displayed the opposite of the hard-e asy effect. We conclude that the patterns of confidence estimates (in the f orm of Brier scores), and thus students' ability to recognize whether their information need has been fulfilled, differ with varying degrees of expert ise in both the personal knowledge responses and the database-assisted resp onses for both the partial credit and binary formats. Taking into considera tion the fact that when subjects, in this case future medical practitioners , are extremely overconfident, they stop looking for information long befor e they have found material that is relevant, the results have broad implica tions for medical practice and information seeking.