PARASITE - MINING STRUCTURAL INFORMATION ON THE WEB

Web information retrieval tools typically make use of only the text on pages, ignoring valuable information implicitly contained in links. A t the ether extreme, viewing the Web as a traditional hypertext system would also be mistake, because heterogeneity, cross-domain links, and the dynamic nature of the Web mean that many assumptions of typical h ypertext systems do not apply. The novelty of the Web leads to new pro blems in information access, and it is necessary to make use of the ne w kinds of information available, such as multiple independent categor ization, naming, and indexing of pages. This paper discusses the varie ties of link information (not just hyperlinks) on the Web, how the Web differs from conventional hypertext, and how the links can be exploit ed to build useful applications. Specific applications presented as pa rt of the ParaSite system find individuals' homepages, new locations o f moved pages, and unindexed information. (C) 1997 Published by Elsevi er Science B.V.