A multithreaded web crawler written in Rust.
This project aims to be an easy-to-use, fast web crawler. Initial goals are:
- Define a CLI and output features
- Write tests
- Test performance
- Fix multithreading waiting and add channels to communicate progress
- GUI -- maybe conrad?