Skip to content

Latest commit

 

History

History
executable file
·
99 lines (65 loc) · 3.77 KB

README.md

File metadata and controls

executable file
·
99 lines (65 loc) · 3.77 KB
Raw

Proxyrequest - Proxy lists, Rotating proxy, Bypass Cloudflare

With this tool you can:

  1. Get proxy lists for parsing from API endpoint, curl or php
  2. Rotating proxy for parsing anything - proxy are being changed automatically until website returns proper content
  3. Parsing pages protected by Cloudflare from scraping

Free plans available for each usage case

If you are looking for a way to parse website which is protected by cloudflare or some other custom made solution you are in the right place.

Usually if you need to get a few dozens of pages from website you can go directory for website and scrape data easily. Issues comes if website has some kind of protection you need to get a lot of data on regular basis.

We handle all blocking from protection on our behalf. You get data like you were requesting them directly.

This solution works for parsing and collection of data. It doesn't work for DDOS, spam sending or abusing internet.

Javascript is optionally executed if you need it. Essentially it's slower than just getting page as is so consider finding a way to get data without Javascript execution.

Free proxy lists

1. Inside browser

Link to free proxy list

2. Using curl:

curl http://public.proxyrequest.ru/api/proxyget/free

3. PHP composer package:

Run first composer command in your shell: composer require gorlovka/proxy-request-builder

<?php

use Proxyrequest\ProxyRequestGet;

$proxyRequestGet = new ProxyRequestGet();
echo $proxyRequestGet->sendRequest();

See TestProxyGet.php file for example.

Rotating proxy

1. Inside browser

Link to url

2. Using curl

bash tests/TestCurlRotateProxy.sh

3. PHP composer package

Run first composer command in your shell: composer require gorlovka/proxy-request-builder

<?php

use Proxyrequest\ProxyRequestRotate;

$proxyRequestRotate = new ProxyRequestRotate('URL_TO_GET', 'PRIVATE_TOKEN_KEY_HERE');
echo $proxyRequestRotate->sendRequest();

Cloudflare bypassing

Not publicly available. Available upon request. Possibility of it depends on how it's configured on exact website. Feel free to get in touch mentioning the address of website and how many pages per day is it needed to collect.

Getting Token

Currently, there are three types of tokens

  1. Proxy lists free token is here

  2. Rotating proxy free token is here

  3. Cloudflare token (to be released soon)

Private token removes time limits in accessing to proxy lists. Allows filtering. New features may be added upon request.

Token specifics

You should use these proxies responsibly, without abusing them, and without intent to commit illegal activity.

There are three kind of tokens:

  1. Proxy lists Paid token removes time limits in accessing to proxy lists. Allows filter by type, country, ip mask, last check, speed, level.

  2. Rotating proxy Software built upon proxy lists. Which consumes target url to be parsed and it manages to get content from website upon your request. Paid token allows here to do such requests. Free testing period available.

  3. Bypassing cloudflare(any other protection) for parsing Software on our side goes to specified url which is behind protection and gives you content of it back. Free testing period available

We have no limits on traffic. If you have big count of requests it's possible to provide dedicated resources just for you.

Contacts

Email for contacts is [email protected].