Skip to content

Latest commit

 

History

History
37 lines (27 loc) · 1.49 KB

README.md

File metadata and controls

37 lines (27 loc) · 1.49 KB

Welcome to the golang web scraper

Work in progress... (i mean it)


How to launch:

  1. Download docker compose on your machine
  2. Uncomment marked string in main.go file, for creating tables (comment it after first sucessfull launch)
  3. Download this repo
  4. Run (from the root directory): docker compose build
  5. Run: docker compose up
  6. Enjoy! ;p

What is used for what:

  • Go - the basis of the parser, sends requests, searches for data (+ htmlquery)
  • Js - handles javascript on found pages if necessary (+ puppetteer)

Other projects using this parser:


What resources does the parser use: