Package com.norconex.collector.http.crawler

package com.norconex.collector.http.crawler

Related Packages

Package	Description
com.norconex.collector.http

Class	Description
HttpCrawler	The HTTP Crawler.
HttpCrawlerConfig	HTTP Crawler configuration.
HttpCrawlerConfig.HttpMethodSupport
HttpCrawlerConfig.ReferencedLinkType
HttpCrawlerEvent	HTTP Crawler event names.
IStartURLsProvider	Provide starting URLs for crawling.
URLCrawlScopeStrategy	By default a crawler will try to follow all links it discovers.