company-scraper
-
Alaska :- "https://www.commerce.alaska.gov/cbp/main/search/entities" => Captcha Problem
-
California :- "https://businesssearch.sos.ca.gov/" => completed
-
Florida :- "http://search.sunbiz.org/Inquiry/CorporationSearch/ByName" => Done(need to check)
-
Montana :- "https://www.mtsosfilings.gov/mtsos-master/viewInstance/view.html" =>(only one field need to fetch) half remaining
-
Nevada :- "http://nvsos.gov/sosentitysearch/" => completed
-
South Dakota :- "https://sosenterprise.sd.gov/BusinessServices/Business/FilingSearch.aspx" => Done(need to check)
-
Delaware :- "https://icis.corp.delaware.gov/Ecorp/EntitySearch/NameSearch.aspx" => Captcha Probblem
-
Wyoming :- "https://wyobiz.wy.gov/business/" => completed
-
Utah :- "https://secure.utah.gov/bes/" => completed
-
Oregon :- "http://egov.sos.state.or.us/br/pkg_web_name_srch_inq.login" ==> site isn't working
-
SilverFlume :- "https://www.nvsilverflume.gov/account/login" => remaining
-
Indiana :- "https://bsd.sos.in.gov/publicbusinesssearch" => site is in maintenance
-
New Hampshire :- "https://quickstart.sos.nh.gov/online/Account" => maintenance
-
cdtfa :- "https://services.cdtfa.ca.gov/ereg/index.boe" => remaining
=> cdtfa => dropdown selection
======= #Sample request GET http://localhost:4040/api/scrape-nevada/get-data?keyword=ABC&host=http://nvsos.gov/ GET http://localhost:4040/api/scrape-nevada/get-detail?link=http://nvsos.gov/sosentitysearch/CorpDetails.aspx?lx8nvq=jdXjyHFI5Q7KdLbv95oA%252fg%253d%253d&nt7=0
#Nginx Config `server { listen 80; server_name DOMAIN_NAME; client_max_body_size 20M;
location / {
proxy_pass http://127.0.0.1:9000;
proxy_http_version 1.1;
proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection $connection_upgrade;
proxy_set_header X-Forwarded-For $remote_addr;
if ($uri != "/") {
expires 30d;
}
}
}`
#Deployment Install PM2 Clone repo or pull Use node version v6.8.0 npm install export NODE_ENV="production" pm2 start --name company-scraper dist/index.js
pm2 logs company-scraper --lines 100 (check error logs)
- Note: ufw might block
d959fe270d93180614b2e59e68b6a9faa81143d6
==========
user: [email protected] pass: GooglePlay#9