23 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
messense	119f067b1e	Lock dependencies version to minor	2016-01-14 09:29:27 +08:00
messense	255166313f	Merge pull request #1 from svmk/master ... Added get_crawl_delay function	2016-01-14 09:27:22 +08:00
Mikhail Svetov	02eedd6246	Improvements.	2016-01-13 21:18:07 +07:00
Mikhail Svetov	f6168c3ea2	Changed version.	2016-01-13 20:53:33 +07:00
Mikhail Svetov	49a2b9c93d	Added crawl delay feature.	2016-01-13 20:51:54 +07:00
messense	04c25dda65	Bump version to 0.2.0	2015-10-21 15:40:44 +08:00
messense	ac7d7aa8db	Refactor some API to be more generic over Rust strings	2015-10-21 15:40:06 +08:00
messense	685853e729	Update .travis.yml to test on Rust stable	2015-09-22 09:47:54 +08:00
messense	160ed940ae	Use join instead of connect	2015-08-12 17:53:28 +08:00
messense	8c20000a47	Windows CI build fix again	2015-07-05 00:10:51 +08:00
messense	b23797ef26	Try to fix OpenSSL issue on Windows CI	2015-07-04 23:58:03 +08:00
messense	1b09968d3a	Remove Rust stable from test env	2015-07-04 23:48:00 +08:00
messense	abe10abd9a	Update CI configurations	2015-07-04 23:43:25 +08:00
messense	179d6e5f87	Update README.md	2015-07-04 23:43:10 +08:00
messense	cbe515e761	Add RobotFileParser.read test case	2015-07-01 10:23:07 +08:00
messense	e27e17589c	Remove illegal keyword robots.txt from Cargo.toml	2015-07-01 00:20:50 +08:00
messense	41351bc68f	Update package metadata	2015-07-01 00:04:39 +08:00
messense	8e2944d8a4	Bug fixes and add more test cases	2015-07-01 00:01:15 +08:00
messense	e8928ec198	Bug fix and add more tests	2015-06-28 09:59:52 +08:00
messense	6153773f24	Correct the usage of RefCell.borrow	2015-06-28 01:39:03 +08:00
messense	7c7f09012e	Create README.md	2015-06-28 01:30:41 +08:00
messense	ece1e1f3c4	Initial commit.	2015-06-28 01:29:05 +08:00
messense	2a2ebd6a13	Initial commit	2015-06-28 01:28:41 +08:00