Releases: Norconex/crawlers
Releases · Norconex/crawlers
norconex-collector-http-1.1.1
Bugfix release:
- Fixed not being able to extract the "href" attribute when it starts a new line.
- Fixed HTTP redirects not storing final target URL but the source URL instead.
norconex-collector-http-1.1.0
Increased performance, sitemap support, BASIC and DIGEST auth support, in-page robot support, ftp:// URL support. More: http://www.norconex.com/product/collector-http/changes-report.html
norconex-collector-http-1.0.2
DefaultURLExtractor now handle URLs starting with ? properly and those prefixed with "URL=" (e.g. meta http-equiv="refresh")