Package com.norconex.collector.http.crawler

Interface IStartURLsProvider

public interface IStartURLsProvider
Provide starting URLs for crawling. Implement this interface if you need start URLs to be established dynamically when the crawler starts.
Since:
2.7.0
Author:
Pascal Essiembre

  • Method Summary

    Modifier and Type
    Method
    Description
    Iterator<String>
    provideStartURLs()
    Provides an iterator over start URLs.

  • Method Details

    • provideStartURLs

      Iterator<String> provideStartURLs()
      Provides an iterator over start URLs. If you have a limited set that is easier to return as array or list, consider wrapping the return value in ObjectArrayIterator or ObjectArrayListIterator.
      Returns:
      iterator of URL strings