Skip to content

hellolol2016/EquilibriNews

Repository files navigation

News Article Web Scraper

Overview

This web scraper is designed to extract news articles from popular news sites. It utilizes NextJS for frontend frameworks, Toastify for notifications, Playwright / Puppeteer for browser imitation, and MantineUI for UI elements.

Features

Multi-site Support: Scrapes news articles from a variety of popular news websites.

Vox Logo Fox Logo WSJ Logo NYT Logo ABC Logo R Logo NW Logo

Customizable To Personal Taste: Content is adjusted based on the user's input to balance out political bias. Gallery vs List: Short gallery that includes the biggest headlines as well as a comprehensive list of important articles.

Getting Started

Prerequisites

Have NPM installed :D

Installation

Clone the repository: git clone https://github.com/hellolol2016/EquilibriNews

Install dependencies: npm install or pip install -r requirements.txt

Animated GIF

Usage

Input your political rating and go on a journey of self-discovery (if you need to)

Animated GIF

Wait a little bit for the scraper to load (it may take up to 2 minutes!)

Animated GIF

Browse the gallery to see some of the biggest headlines

Animated GIF

Switch back and forth from the Gallery and List modes

Animated GIF

Access the original articles from the original site!

Animated GIF

Contributing

Shoutout to Melissa Amaya for her words of encouragement & guidance and ndom91 for showing me hope in my darkest hours (trying to deploy this)