Skip to content

A NestJS microservices app using NATS that politely polls the 4chan API for all threads and posts in a board and dumps them in a SQLite database. Currently at 25gb of data saved and climbing.

License

Notifications You must be signed in to change notification settings

chrismeller/fourchan-monitor

Repository files navigation

Fourchan Monitor

A NestJS microservices app using NATS that politely polls the 4chan API for all threads and posts in a board and dumps them in a SQLite database.

Key Features

  1. Modern. Uses the NestJS framework for a fully modern, microservices approach, all in Typescript.
  2. Fully asynchronous. Uses NATS for async processing and communication.
  3. Scalable. Uses SQLite for storage with batch operations properly wrapped in transactions.
  4. Polite. Properly uses ETag and Last-Modified headers with HEAD requests to reduce load and traffic to the API.
  5. Stable. A tried-and-true stack that's easy to maintain. No surprises here.
  6. Up-to-date and secure. Renovate and Bolt from WhiteSource keep dependencies updated and secure.
  7. Easy. Fully Docker-based.

Usage

Just edit the paths for your database volume in the compose file, then docker-compose up -d. When it's time to update, simply docker-compose pull && docker-compose up -d.

About

A NestJS microservices app using NATS that politely polls the 4chan API for all threads and posts in a board and dumps them in a SQLite database. Currently at 25gb of data saved and climbing.

Topics

Resources

License

Stars

Watchers

Forks

Packages