Commit graph

4 commits

Author SHA1 Message Date
messense
408f792ebd Commit Cargo.lock to git for cache to actually work 2020-03-30 09:42:35 +08:00
svmk
2d19755779
Refactoring of robotparser-rs (#20)
* Migrated sites into robotsparser file.

* Robots.txt refactoring.

* Migrated to new version of url and reqwest.
2020-01-31 17:00:58 +08:00
messense
384ae57caa Add .vscode/ to .gitignore 2016-08-21 11:00:21 +08:00
messense
ece1e1f3c4 Initial commit. 2015-06-28 01:29:05 +08:00