Package com.norconex.collector.http.delay.impl
package com.norconex.collector.http.delay.impl
-
ClassDescriptionConvenience class to encapsulate various delay strategies.Base implementation for creating voluntary delays between URL downloads.It is assumed there will be one instance of this class per crawler defined.Default implementation for creating voluntary delays between URL downloads.Introduces different delays between document downloads based on matching document reference (URL) patterns.