Skip to content

Scrapers used by the Guardbook to gather all types of roster data

Notifications You must be signed in to change notification settings

tacoman/guardbook-scrapers

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

This repo contains scrapers for the opponent rosters and the DCFC headshots on detcityfc.com. To use, install Colly:

go get -u github.com/gocolly/colly/...

For 2019 NPSLMC rosters: run scraper.go. The resulting JSON file is compatible with the Hooligan Hymnal/Guardbook's FOES MAD feature.

For 2019 UWS rosters: run scraper.go. This is also for the FOES MAD feature, and is a prototype for the 2020 season.

For headshots: run headshots.go. This will output one JPEG per player into the current directory.

USLC note: this is in-progress and will be switching to Python. pip install selenium apt install firefox-geckodriver

About

Scrapers used by the Guardbook to gather all types of roster data

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published