Package com.norconex.collector.http.crawler

Interface Summary

Interface	Description
IStartURLsProvider	Provide starting URLs for crawling.

Class Summary

Class	Description
HttpCrawler	The HTTP Crawler.
HttpCrawlerConfig	HTTP Crawler configuration.
HttpCrawlerEvent	An HTTP Crawler Event.
URLCrawlScopeStrategy	By default a crawler will try to follow all links it discovers.