-
Notifications
You must be signed in to change notification settings - Fork 292
Pull requests: apache/stormcrawler
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Run redirect hops through the URL filters
#2128
opened Sep 6, 2026 by
abhinav-phi
Contributor
Loading…
Keep the fetcher off private address space by default
#2127
opened Sep 5, 2026 by
abhinav-phi
Contributor
Loading…
OKHttp: authenticated TLS by default, credentials withheld from unauthenticated servers
#2126
opened Sep 5, 2026 by
abhinav-phi
Contributor
Loading…
SiteMapParserBolt: strict parsing, opt-in sniffing, non-terminal parse failure
#2125
opened Sep 5, 2026 by
abhinav-phi
Contributor
Loading…
File scheme off by default; reads confined to file.protocol.root
#2124
opened Sep 5, 2026 by
abhinav-phi
Contributor
Loading…
Spouts check the scheme of stored URLs before emitting
#2123
opened Sep 5, 2026 by
abhinav-phi
Contributor
Loading…
Canonicalise hosts for politeness queues and the robots.txt cache
#2122
opened Sep 5, 2026 by
abhinav-phi
Contributor
Loading…
Robots.txt fetch no longer replaces the configured content limit
#2121
opened Sep 5, 2026 by
abhinav-phi
Contributor
Loading…
URLFilters: treat an exception from a filter as a rejection
#2120
opened Sep 5, 2026 by
abhinav-phi
Contributor
Loading…
IPFilterRules: add anylocal and multicast keywords, fail on unparseable rules
#2119
opened Sep 5, 2026 by
abhinav-phi
Contributor
Loading…
Use batch endpoint in URLFrontier module for DISCOVERED urls
urlfrontier
#2117
opened Sep 2, 2026 by
abhinav-phi
Contributor
Loading…
feat: implement MIME type whitelist filtering in ParserBolt for Tika-…
#2116
opened Sep 1, 2026 by
Riddhish1
Loading…
#315 Adaptative URL filter to normalize URLs based on canonical tag
#2052
opened Aug 16, 2026 by
akash-manna-sky
Loading…
7 of 10 tasks
#1998 WARC writer: WARC-Protocol header to follow WARC field proposals
#2034
opened Jul 29, 2026 by
sebastian-nagel
Contributor
Loading…
#108 Normalize misspelled HTTP headers
#2006
opened Jul 19, 2026 by
HarshDevelops
Loading…
9 of 10 tasks
ProTip!
no:milestone will show everything without a milestone.