Norconex Crawler V4 is here, in beta. A rewritten crawler with a free visual configurator — give it a try and tell us what you think. Try the beta →

Norconex Crawler Core

Open-Source Crawler Core Library

Documentation Download

Core Crawler library

The Norconex Crawler Core is a library containing features and reusable code shared between all crawlers. It is not an executable application.

If you are looking for a web crawler, filesystem crawler or else, check out Norconex Web Crawler or Norconex File System Crawler.

Use this library if you are interested to build a new crawler, or if you want to replace the Crawler Core version you have with your downloaded Crawler zip file with a more recent one.

Refer to the API documentation for many of the features that are shared features between all crawlers.

Latest news

Norconex v3 Stack 3.2.0 Released
2026-08-31
The synchronized v3 stack -- 13 modules sharing one version -- is now published to Maven Central, with updated documentation and API docs for every module. More...

Norconex Crawler v4 Beta Is Here
2026-08-30
A rewritten crawler, a free visual configurator, and documentation generated straight from the code. It's feature-complete and we want you to try to break it. More...

Norconex Google Cloud Search Committer in v3 Stack
2026-07-01
Google Cloud Search Committer now has a Norconex-managed 3.x release line in the v3 stack. The legacy 2.x line developed and hosted by Google remains available. More...

Norconex Filesystem Collector joins v3 Stack
2026-07-01
File System Crawler now has a Norconex-managed 3.x release line in the synchronized v3 stack, while the legacy 2.x line remains available. More...

Norconex v3 Stack Coordinates Update
2026-07-01
The v3 train now uses synchronized 3.2.0 versions across the stack under the existing com.norconex.collectors groupId. One exception: the Elasticsearch Committer, previously on its own 5.x numbering, is realigned to 3.2.0 under com.norconex.collectors.v3-align so its new release does not collide with its existing 5.x line. More...