Interface | Description |
---|---|
IStartURLsProvider |
Provide starting URLs for crawling.
|
Class | Description |
---|---|
HttpCrawler |
The HTTP Crawler.
|
HttpCrawlerConfig |
HTTP Crawler configuration.
|
HttpCrawlerEvent |
HTTP Crawler event names.
|
URLCrawlScopeStrategy |
By default a crawler will try to follow all links it discovers.
|
Enum | Description |
---|---|
HttpCrawlerConfig.HttpMethodSupport | |
HttpCrawlerConfig.ReferencedLinkType |
Copyright © 2009–2023 Norconex Inc.. All rights reserved.