| Class and Description | 
|---|
| HttpCrawlerConfig HTTP Crawler configuration. | 
| IStartURLsProvider Provide starting URLs for crawling. | 
| URLCrawlScopeStrategy By default a crawler will try to follow all links it discovers. | 
| Class and Description | 
|---|
| HttpCrawler The HTTP Crawler. | 
| HttpCrawlerConfig HTTP Crawler configuration. | 
| Class and Description | 
|---|
| HttpCrawler The HTTP Crawler. | 
| HttpCrawlerConfig HTTP Crawler configuration. | 
| Class and Description | 
|---|
| HttpCrawler The HTTP Crawler. | 
| HttpCrawlerConfig HTTP Crawler configuration. | 
| Class and Description | 
|---|
| HttpCrawlerConfig HTTP Crawler configuration. | 
| Class and Description | 
|---|
| HttpCrawlerConfig HTTP Crawler configuration. | 
Copyright © 2009–2021 Norconex Inc.. All rights reserved.