Full-featured, flexible and extensible.
Run on any platform.
Crawl what you want, how you want.
Web crawler for the Internet or Intranet.
Crawl data from local disk, FTP, SFTP, WebDAV, HDFS, ...
Why chose Norconex Crawlers? Click here or on a
feature to learn more.
Real feedback from real Github users. Click a quote to view its origin.
Essential components used to store collected data
in a location or technology of your choice, such as:
Parse, extract, manipulate content. Part of every collector.
Shared library holding common Crawler code and features.