Norconex Web Crawler

Download

Binaries

The most recent stable Norconex Web Crawler release in the 3.x series.

Release date2022-01-05
Change log

Latest development build of Norconex Web Crawler for the next release in the 3.x series.

Release date2022-04-11
Change log

The most recent stable Norconex Web Crawler release in the 2.x series.

Release date2021-10-18
Change log

Past versions

Archives for past versions of Norconex Web Crawler are available on Maven Central repository.

Source

Source code can be obtained on GitHub: https://github.com/Norconex/collector-http.

Maven

Maven users can add the following to their pom.xml:

<dependency>
  <groupId>com.norconex.collectors</groupId>
  <artifactId>norconex-collector-http</artifactId>
  <version>3.0.0</version>
</dependency>

Use the following for the latest snapshot release:

<dependency>
  <groupId>com.norconex.collectors</groupId>
  <artifactId>norconex-collector-http</artifactId>
  <version>3.0.1-SNAPSHOT</version>
</dependency>

For snapshot releases, make sure to include the public Sonatype Maven repository:

<repository>
  <id>sonatype.oss.snapshots</id>
  <name>Sonatype OSS Snapshot Repository</name>
  <url>http://oss.sonatype.org/content/repositories/snapshots</url>
  <releases>
    <enabled>false</enabled>
  </releases>
  <snapshots>
    <enabled>true</enabled>
  </snapshots>
</repository>