Chuper

A simple and extensible web crawler built on top of fetchbot.

Name	Name	Last commit message	Last commit date
Latest commit oli-g Merge pull request #5 from oli-g/add_depth_to_command Apr 2, 2016 0099c3b · Apr 2, 2016 History 47 Commits
cmd/seed	cmd/seed	Add Depth to Command and Context interfaces	Oct 4, 2015
.gitignore	.gitignore	Initial commit	May 27, 2015
LICENSE	LICENSE	Initial commit	May 27, 2015
README.md	README.md	Initial commit	May 27, 2015
cache.go	cache.go	Add a Context, a Processor and a document Handler	Jun 4, 2015
command.go	command.go	Add Depth to Command and Context interfaces	Oct 4, 2015
context.go	context.go	Add Depth to Command and Context interfaces	Oct 4, 2015
crawler.go	crawler.go	Add Depth to Command and Context interfaces	Oct 4, 2015
processor.go	processor.go	Start to work on an Enqueuer interface	Jul 23, 2015
queue.go	queue.go	Add Depth to Command and Context interfaces	Oct 4, 2015

Provide feedback