Design and Implementation of a Distributed Crawler and Filtering Processor

This publication has 8 references indexed in Scilit:

• Searching the Web
  ACM Transactions on Internet Technology, 2001
• The Ninja architecture for robust Internet-scale systems and services
  Computer Networks, 2001
• Focused crawling: a new approach to topic-specific Web resource discovery
  Computer Networks, 1999
• Mercator: A scalable, extensible Web crawler
  World Wide Web, 1999
• SPHINX: a framework for creating personal, site-specific Web crawlers
  Computer Networks and ISDN Systems, 1998
• The anatomy of a large-scale hypertextual Web search engine
  Computer Networks and ISDN Systems, 1998
• Efficient crawling through URL ordering
  Computer Networks and ISDN Systems, 1998
• The Harvest information discovery and access system
  Computer Networks and ISDN Systems, 1995