Package com.norconex.collector.http.crawler
package com.norconex.collector.http.crawler
-
ClassDescriptionThe HTTP Crawler.HTTP Crawler configuration.HTTP Crawler event names.Provide starting URLs for crawling.By default a crawler will try to follow all links it discovers.