Skip to content

Latest commit

 

History

History
25 lines (16 loc) · 367 Bytes

README.md

File metadata and controls

25 lines (16 loc) · 367 Bytes

Crawley3 Toolbox

Crawley Toolbox implementation for python3 using asyncio.

###Requirements

  • python >= 3.3
  • asyncio
  • aiohttp

###Example

from src.crawlers import BaseCrawler

class PyCrawler(BaseCrawler):

    start_urls = ["http://python.org"]

if __name__ == "__main__":
    crawler = PyCrawler(debug=True)
    crawler.start()