A tutorial on web scraping and crawling aimed to get you up and running in 15 minutes.
Make sure to update your login info in the credentials.rb file.
To run each file navigate to the main directory (web_scraper) in your terminal and run the word ruby
followed by the name of the file. Example:
$ ruby auto_follow.rb
or
$ ruby auto_liker.rb
I've made some fairly simple updates since the videos.
- changed the
while true
loops toloop do
loops with a break condition using a constant variable set at top - added more variables for counting, tracking, and info output
- added top 100 users on instagram at the bottom of
auto_follow.rb
watir for crawling in live browser
pry ruby REPL
rb-readline ruby IRB and dependency of pry
awesome-print for clearer console output