a golang webcrawler
not like the old one where u need to setup an sql db just setup a couchdb with a scope/bucket called CrawledDocuments, and two collections 1 - CrawledDocuments 2 - Robots
i know namings arent the best working on that !
| Name | Name | Last commit date | ||
|---|---|---|---|---|