TikTok Scraper

Scraper for Black Lives Matter posts. Uses: https://github.com/drawrowfly/tiktok-scraper

Requirements

• Docker Desktop
• If using Linux make sure docker and docker-compose are available at command line

Instructions

• Edit the HASHTAGS array in scrape.sh to set the hashtags to scrape
• Edit NUM_POSTS in scrape.sh to specify number of posts to scrape. This is the number scraped per hashtag, not in total.
• Run: docker-compose up --build

Notes

• Combining CSVs and removing duplicate rows: awk '(NR == 1) || (FNR > 1)' *.csv | awk '!v[$1]++' > combined.csv Note: Need to fix this