Citation ranking versus peer evaluation of senior faculty research performance: A case study of Kurdish scholarship

Citation
Li. Meho et Dh. Sonnenwald, Citation ranking versus peer evaluation of senior faculty research performance: A case study of Kurdish scholarship, J AM S INFO, 51(2), 2000, pp. 123-138
Citations number
73
Categorie Soggetti
Library & Information Science
Journal title
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE
ISSN journal
00028231 → ACNP
Volume
51
Issue
2
Year of publication
2000
Pages
123 - 138
Database
ISI
SICI code
0002-8231(20000115)51:2<123:CRVPEO>2.0.ZU;2-M
Abstract
The purpose of this study is to analyze the relationship between citation r anking and peer evaluation in assessing senior faculty research performance . Other studies typically derive their peer evaluation data directly from r eferees, often in the form of ranking, This study uses two additional sourc es of peer evaluation data: citation content analysis and book review conte nt analysis. Two main questions are investigated: (a) To what degree does c itation ranking correlate with data from citation content analysis, book re views, and peer ranking? (b) Is citation ranking a valid evaluative indicat or of research performance of senior faculty members? Citation data, book r eviews, and peer ranking were compiled and examined for faculty members spe cializing in Kurdish studies. Analysis shows that normalized citation ranki ng and citation content analysis data yield identical ranking results. Anal ysis also shows that normalized citation ranking and citation content analy sis, book reviews, and peer ranking perform similarly (i.e., are highly cor related) for high-ranked and low-ranked senior scholars, Additional evaluat ion methods and measures that take into account the context and content of research appear to be needed to effectively evaluate senior scholars whose performance ranks relatively in the middle. Citation content analysis data did appear to give some specific and important insights into the quality of research of these middle performers, however, further analysis and researc h is needed to validate this finding. This study shows that citation rankin g can provide a valid indicator for comparative evaluation of senior facult y research performance.