All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog and this project adheres to Semantic Versioning.
- Ignore invalid SSL certificates
- Log response headers
- Don't visit URLs twice (introduced with v0.4.0-alpha)
Logging
- Add "Save downloaded data to disk" to the roadmap (feature request #1)
- Log results to a log file
- Add Github actions
- Add support for non-sitemap URLs
- Capture the parent URL
- Switch from go 1.14 to 1.15
- Shut down the UI 10 seconds after the crawler finished
- Remove the TERABYTE constant from the byte formatter so cross-compilation for ARM works
- Remove the
reset
command hint from the troubleshooting section of the README - Start the timer only after the links in the XML sitemap(s) have been read
- Stop counting the seconds after the crawler finished
- Remove the debug console from the command-line ui
The Prototype
- The gargantua prototype