Abstract
The problem of developing an intelligent Internet search engine for creating topic-specific collections is considered. To improve the efficiency of discovering topic-related resources, a specialized network crawling algorithm is developed that uses information on the relevance of the Web pages already visited to evaluate the usefulness of new pages.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Aalbersberg, I.J., Incremental Relevance Feedback,Proc. 15th Annual Int. ACM Conf. on Research and Development in Information Retrieval (SIGIR'92), 1992, pp. 11–22.
Allan, J., Incremental Relevance Feedback,Proc. 19th Int. ACM Conf. on Research and Development in Information Retrieval (SIGIR'96), 1996, pp. 298–306.
Ardö, A. and Lundberg, S., A Regional Distributed WWW Search and Indexing Service—the DESIRE Way,Comput. Networks ISDN Syst., 1998, vol. 30, pp. 173–183.
Bessonov, M., Heuser, U., Nekrestyanov, I., and Patel, A., Open Architecture for Distributed Search Systems,Proc. Sixth Int. Conf. on Intelligence in Services and Networks, 1999.
Ledeneva, E., O'Maera, T., Nekrestyanov, I., and Patel, A., Building Topic-Specific Collections with Intelligent Agents,Proc. Sixth Int. Conf. on Intelligence in Services and Networks, 1999.
Bowman, C.M., Danzig, P.B., Hardy, D.R., Manber, U., and Schwartz, M.F., The Harvest Information Discovery and Access System,Comput. Networks ISDN Syst., 1995, December, pp. 119–125.
Callan, J., Document Filtering with Inference Networks,Proc. 19th Int. ACM Conf. on Research and Development in Information Retrieval (SIGIR'96), 1996, pp. 262–269.
Cheong, F.,Internet Agents: Spiders, Wanders, Brokers, and Bots, New Riders, Indian., 1996.
Cho, J., Garcia-Molina, H., and Page L., Efficient Crawling through URL Ordering,Proc. Seventh Int. World Wide Web Conf., 1998.
Koch, T., Ardö, A., Bremmer, A., and Lundberg, S., The Building and Maintenance of Robot Based Internet Search Services: A Review of Current Indexing and Data Collection Methods,Lund Univ. Library, State-of-the-Art Report, D3.11, Sweden, 1996.
Koster, M., Robots in the Web: Threat or Treat?ConneX-ions, 1995, vol. 9, no. 4.
Lawrence, S. and Giles, C.L., Searching the World Wide Web,Science, 1998, vol. 280, no. 5360, pp. 98–100.
Page, L., Brin, S., and Motwani, R., The Pagerank Citation Ranking: Bringing Order to the Web,Proc. Seventh Int. World Wide Web Conf., 1998.
Pincerton, B., Finding What People Want: Expierences with the Webcrawler,Proc. Second Int. World Wide Web Conf., 1994.
Salton, G. and Buckley, C., Term-Weighting Approaches in Automatic Text Retrieval,Inf. Process. Manag., 1988, vol. 24, pp. 513–523.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Romanova, E.V., Romanov, M.V. & Nekrest'yanov, I.S. Using intelligent internet robots for building topic-specific collections. Program Comput Soft 26, 163–169 (2000). https://doi.org/10.1007/BF02759315
Issue Date:
DOI: https://doi.org/10.1007/BF02759315