New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CrawlerModel에 craken 적용 #2

Open

bleujin opened this issue Jun 4, 2013 · 1 comment

Assignees

Owner

bleujin commented Jun 4, 2013

No description provided.

ghost assigned bleujin

Owner Author

bleujin commented Jun 10, 2013

현재 CrawlerModel은 MaxDepth와 MaxIteratoration Model 2가지가 있다.
2가지 모두 해당 정보를 Ram을 통해 관리 하기 때문에.

분산 크롤링이 안된다.
아주 큰 사이트를 크롤링 할 수 없다.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment