Spring Boot + JSoup + ROME

Web scraper and RSS feed generator

Spring Boot based example application for website scraping and RSS feed generation.

Technologies

• Spring Boot
• Gradle
• JSoup
• ROME
• Lombok
• PostgreSQL

Configuration

• Create PostgreSQL database and configure connection in application.properties

• Build with Gradle

  ./gradlew build

Endpoints

• GET /scrap – Scrap all websites on demand

• GET /rss – Get general RSS feed

• GET /rss/<TARGET_WEBSITE_ID> – Get RSS feed for specific website

More information

• Blog post: Web scraper and RSS feed generator with Spring Boot