Skip to content
@spider-rs

spider-rs

Your friendly neighborhood spiderbot.

Popular repositories Loading

  1. spider spider Public

    A web crawler and scraper for Rust

    Rust 1.6k 139

  2. spider-py spider-py Public

    Spider ported to Python

    Rust 77 11

  3. spider-nodejs spider-nodejs Public

    Spider ported to Node.js

    Rust 42 7

  4. headless-browser headless-browser Public

    Headless browser - reliable high performance setup for cloud providers like Fargate, CloudRun, and more.

    Rust 39 5

  5. html2md html2md Public

    HTML to markdown for Rust

    HTML 33

  6. ua_generator ua_generator Public

    Pre-compiled random real User-Agents. Updated weekly for windows, mac, linux, and android

    Rust 31 3

Repositories

Showing 10 of 24 repositories
  • spider Public

    A web crawler and scraper for Rust

    spider-rs/spider’s past year of commit activity
    Rust 1,648 MIT 139 0 0 Updated Apr 21, 2025
  • spider-clients Public

    Python, Javascript, and Rust libraries for the Spider Cloud API.

    spider-rs/spider-clients’s past year of commit activity
    Python 12 MIT 5 0 0 Updated Apr 21, 2025
  • reqwest Public Forked from seanmonstar/reqwest

    An easy and powerful Rust HTTP Client

    spider-rs/reqwest’s past year of commit activity
    Rust 0 Apache-2.0 1,222 0 0 Updated Apr 20, 2025
  • ua_generator Public

    Pre-compiled random real User-Agents. Updated weekly for windows, mac, linux, and android

    spider-rs/ua_generator’s past year of commit activity
    Rust 31 MIT 3 0 0 Updated Apr 20, 2025
  • hyper-util Public Forked from hyperium/hyper-util

    Common utilities used with hyper.

    spider-rs/hyper-util’s past year of commit activity
    Rust 0 MIT 139 0 0 Updated Apr 17, 2025
  • hyper Public Forked from hyperium/hyper

    An HTTP library for Rust

    spider-rs/hyper’s past year of commit activity
    Rust 0 MIT 1,675 0 0 Updated Apr 17, 2025
  • headless-browser Public

    Headless browser - reliable high performance setup for cloud providers like Fargate, CloudRun, and more.

    spider-rs/headless-browser’s past year of commit activity
    Rust 39 MIT 5 0 0 Updated Apr 14, 2025
  • firewall Public

    Firewall for Rust

    spider-rs/firewall’s past year of commit activity
    Rust 0 MIT 0 0 0 Updated Mar 17, 2025
  • spider_scraper Public

    html5ever web scraper used for some of spider-rs CSS transformations

    spider-rs/spider_scraper’s past year of commit activity
    Rust 1 MIT 0 0 0 Updated Mar 16, 2025
  • bad_websites Public

    websites that should be blocked via firewall

    spider-rs/bad_websites’s past year of commit activity
    0 1 0 0 Updated Mar 13, 2025
View all repositories

Top languages

Loading…

Most used topics

Loading…