Norconex Crawler Core

Open-Source Crawler Core Library

Documentation Download

Core Crawler library

The Norconex Crawler Core is a library containing features and reusable code shared between all crawlers. It is not an executable application.

If you are looking for a web crawler, filesystem crawler or else, check out Norconex Web Crawler or Norconex File System Crawler.

Use this library if you are interested to build a new crawler, or if you want to replace the Crawler Core version you have with your downloaded Crawler zip file with a more recent one.

Refer to the API documentation for many of the features that are shared features between all crawlers.

Latest news

Norconex Google Cloud Search Committer in v3 Stack
2026-07-01
Google Cloud Search Committer now has a Norconex-managed 3.x release line in the v3 stack. The legacy 2.x line developed and hosted by Google remains available. More...

Norconex Filesystem Collector joins v3 Stack
2026-07-01
File System Crawler now has a Norconex-managed 3.x release line in the synchronized v3 stack, while the legacy 2.x line remains available. More...

Norconex v3 Stack Coordinates Update
2026-07-01
The v3 train now uses synchronized 3.2.0-SNAPSHOT versions with the new com.norconex.collectors.v3 groupId and Maven path strategy. More...

Norconex Web Crawler 3.1.0 Released
2025-05-24
Additional options for WebDriver fetcher, bug fixes, and others. More...