A STATISTICAL LEARNING APPROACH TO AUTOMATIC-INDEXING OF CONTROLLED INDEX TERMS

Authors
Citation
Ch. Leung et Wk. Kan, A STATISTICAL LEARNING APPROACH TO AUTOMATIC-INDEXING OF CONTROLLED INDEX TERMS, Journal of the American Society for Information Science, 48(1), 1997, pp. 55-66
Citations number
44
Categorie Soggetti
Information Science & Library Science","Information Science & Library Science","Computer Science Information Systems
ISSN journal
00028231
Volume
48
Issue
1
Year of publication
1997
Pages
55 - 66
Database
ISI
SICI code
0002-8231(1997)48:1<55:ASLATA>2.0.ZU;2-#
Abstract
A statistical learning approach to assigning controlled index terms is presented. In this approach, there are two processes: (1) The learnin g process and (2) the indexing process. The learning process construct s a relationship between an index term and the words relevant and irre levant to it, based on the positive training set and negative training set, which are sample documents indexed by the index term, and those not indexed by it, respectively. The indexing process determines wheth er an index term is assigned to a certain document, based on the relat ionship constructed by the learning process, and the text found in the document. Furthermore, a learning feedback technique is introduced. T his technique used in the learning process modifies the relationship b etween an index term and its relevant and irrelevant words to improve the learning performance and, thus, the indexing performance. Experime ntal results have shown that the statistical learning approach and the learning feedback technique are practical means to automatic indexing of controlled index terms.