Skip to content

Releases: Norconex/crawlers

norconex-collector-http-1.1.1

03 Oct 05:01
Compare
Choose a tag to compare

Bugfix release:

  • Fixed not being able to extract the "href" attribute when it starts a new line.
  • Fixed HTTP redirects not storing final target URL but the source URL instead.

norconex-collector-http-1.1.0

22 Aug 04:05
Compare
Choose a tag to compare

Increased performance, sitemap support, BASIC and DIGEST auth support, in-page robot support, ftp:// URL support. More: http://www.norconex.com/product/collector-http/changes-report.html

norconex-collector-http-1.0.2

12 Jul 03:25
Compare
Choose a tag to compare

DefaultURLExtractor now handle URLs starting with ? properly and those prefixed with "URL=" (e.g. meta http-equiv="refresh")