Modifier and Type | Method and Description |
---|---|
ICrawlerConfig[] |
AbstractCollectorConfig.getCrawlerConfigs() |
ICrawlerConfig[] |
ICollectorConfig.getCrawlerConfigs()
Gets all crawler configurations.
|
Modifier and Type | Method and Description |
---|---|
protected abstract ICrawler |
AbstractCollector.createCrawler(ICrawlerConfig config)
Creates a new crawler instance.
|
void |
AbstractCollectorConfig.setCrawlerConfigs(ICrawlerConfig... crawlerConfigs)
Sets crawler configurations.
|
Constructor and Description |
---|
AbstractCollectorConfig(Class<? extends ICrawlerConfig> crawlerConfigClass) |
AbstractCollectorConfig(Class<? extends ICrawlerConfig> crawlerConfigClass,
String xmlConfigRootTag) |
Modifier and Type | Class and Description |
---|---|
class |
AbstractCrawlerConfig
Base Collector configuration.
|
Modifier and Type | Method and Description |
---|---|
ICrawlerConfig |
AbstractCrawler.getCrawlerConfig()
Gets the crawler configuration
|
ICrawlerConfig |
ICrawler.getCrawlerConfig()
Gets the crawler configuration
|
ICrawlerConfig[] |
CrawlerConfigLoader.loadCrawlerConfigs(File configFile) |
ICrawlerConfig[] |
CrawlerConfigLoader.loadCrawlerConfigs(File configFile,
File configVariables) |
ICrawlerConfig[] |
CrawlerConfigLoader.loadCrawlerConfigs(HierarchicalConfiguration xml) |
Modifier and Type | Method and Description |
---|---|
void |
CrawlerConfigLoader.loadCrawlerConfig(ICrawlerConfig config,
XMLConfiguration node)
Loads a crawler configuration, which can be either the default
crawler or real crawler configuration instances
(keeping defaults).
|
Constructor and Description |
---|
AbstractCrawler(ICrawlerConfig config)
Constructor.
|
Constructor and Description |
---|
CrawlerConfigLoader(Class<? extends ICrawlerConfig> crawlerConfigClass) |
Modifier and Type | Method and Description |
---|---|
ICrawlDataStore |
ICrawlDataStoreFactory.createCrawlDataStore(ICrawlerConfig config,
boolean resume)
Creates a new crawl data store.
|
Modifier and Type | Method and Description |
---|---|
ICrawlDataStore |
BasicJDBCCrawlDataStoreFactory.createCrawlDataStore(ICrawlerConfig config,
boolean resume) |
Modifier and Type | Method and Description |
---|---|
ICrawlDataStore |
AbstractMongoCrawlDataStoreFactory.createCrawlDataStore(ICrawlerConfig config,
boolean resume) |
Modifier and Type | Method and Description |
---|---|
ICrawlDataStore |
MVStoreCrawlDataStoreFactory.createCrawlDataStore(ICrawlerConfig config,
boolean resume) |
Modifier and Type | Method and Description |
---|---|
ICrawlerConfig |
BasePipelineContext.getConfig() |
Copyright © 2014–2021 Norconex Inc.. All rights reserved.