Package com.norconex.collector.http.crawler

Interface Summary

Interface	Description
IStartURLsProvider	Provide starting URLs for crawling.

Class Summary

Class	Description
HttpCrawler	The HTTP Crawler.
HttpCrawlerConfig	HTTP Crawler configuration.
HttpCrawlerEvent	HTTP Crawler event names.
URLCrawlScopeStrategy	By default a crawler will try to follow all links it discovers.

Enum Summary

Enum	Description
HttpCrawlerConfig.HttpMethodSupport
HttpCrawlerConfig.ReferencedLinkType