Package com.norconex.collector.http.fetch

Class HttpFetchClient

java.lang.Object

com.norconex.collector.http.fetch.HttpFetchClient

public class HttpFetchClient
extends Object

Fetches HTTP resources, trying all configured http fetchers, defaulting to GenericHttpFetcher with default configuration if none are defined.

Since:

3.0.0

Author:

Pascal Essiembre

Constructor Summary

Constructors

Constructor	Description
HttpFetchClient(CachedStreamFactory streamFactory, List<IHttpFetcher> httpFetchers, int maxRetries, long retryDelay)

Method Summary

Modifier and Type	Method	Description
IHttpFetchResponse	fetch(CrawlDoc doc, HttpMethod httpMethod)
CachedStreamFactory	getStreamFactory()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HttpFetchClient

public HttpFetchClient(CachedStreamFactory streamFactory,
                       List<IHttpFetcher> httpFetchers,
                       int maxRetries,
                       long retryDelay)

Method Detail

getStreamFactory

public CachedStreamFactory getStreamFactory()

fetch

public IHttpFetchResponse fetch(CrawlDoc doc,
                                HttpMethod httpMethod)