A simple crawler-based search engine written in Java.
- MongoDB
- Spark
- Jsoup
- Snowball
- CUDA
- Clone this repository.
- Make sure you have MongoDB server running on
localhost:27017
. - Compile and run the project using at least JDK 1.8.
- Choose
Clear Database
in order to setup the database and collections. - Finally choose
Crawler
and enter the needed number of threads to start crawling the web.
- Apply the
How to use
section described above but chooseStart Server
. - Make sure that the server is listening to
http://localhost:8080
(change the code in both client and server sides to use different port) - Open your browser and visit
http://localhost:8080