Skip to content

Issues: Norconex/crawlers

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

31 Open 800 Closed
31 Open 800 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

URLStatusCrawlerEventListener cannot detect 404 http status
#1107 opened Jan 25, 2025 by narongsaky
3
Proxy Settings "host cannot have character children"
#1106 opened Jan 24, 2025 by ryancasng
1
During incremental crawling, the number of "REJECTED_UNMODIFIED" outputs differs from expectations
#1105 opened Jan 24, 2025 by n-ohbayashi
2
Pom file for Norconex web crawler 3.1.0
#1093 opened Jan 10, 2025 by rukiataliu
3
GenericHttpFetcher Getting "400 Bad Request" Only In Incremental Crawl
#1074 opened Nov 14, 2024 by KarimTantawy
4
Grace_Once For Orphaned Documents stale From automation, when inactive for too long.
#1073 opened Nov 14, 2024 by KarimTantawy
4
Crawler on update: Checksum remains unchanged even if HTML document has been modified
#1071 opened Oct 21, 2024 by stejacob
7
ElasticCommitter - Restrict operation based on action verb (add, update, delete) feature-request
#1070 opened Oct 17, 2024 by stejacob
2
Add Support Base 64 encoding of password feature-request
#1068 opened Oct 2, 2024 by stejacob
3
Stop crawler with version 3 bug resolved
#1067 opened Oct 2, 2024 by DesarrolloCreangel
2
URLNormalizer - encodeNonURICharacters giving an error feature-request resolved
#1063 opened Sep 16, 2024 by stejacob
7
URLNormalizer - removeFragments should ignore SPA pages feature-request resolved
#1061 opened Sep 11, 2024 by stejacob
4
collector v.3 - log4j2 - log-file per crawler feature-request resolved
#790 opened Jun 17, 2022 by jetnet
5
HstsResolver mishandles country code second-level domains bug resolved
#785 opened May 5, 2022 by blue-jam
2
HTTPCollector duplicates listeners when multiple crawlers have set them feature-request
#784 opened May 2, 2022 by dutsuwak
1
Crawl https sitemap with http urls feature-request
#639 opened Sep 9, 2019 by SaschaHeyer
5
i want to test your crawler help me!!! feature-request
#632 opened Aug 19, 2019 by DeveloperYoungsuk
5
ignore www prefix feature-request
#614 opened Jun 18, 2019 by jetnet
4
Question: crawling in similar domain feature-request
#612 opened Jun 8, 2019 by FcrbPeter
7
Crawling JSON feature-request
#601 opened May 10, 2019 by coprisanu
1
Indexing custom fields from a sitemap feature-request
#558 opened Feb 8, 2019 by coprisanu
3
RegexReferenceFilter from file feature-request
#534 opened Oct 31, 2018 by ghost
1
List names of failed jobs when crawl finishes feature-request
#504 opened Jul 11, 2018 by ohtwadi
2
possibility of a com.norconex.collector.http.data.store.impl.dynamodb ? feature-request
#448 opened Dec 28, 2017 by obxpete
3
Is there a way to configure collector behaviour based on IP address? feature-request
#426 opened Nov 14, 2017 by ronjakoi
2
ProTip! Find all open issues with in progress development work with linked:pr.