34 commits

Author	SHA1	Message	Date
messense	548ea65072	Update reqwest to 0.11	2022-03-30 10:15:35 +08:00
svmk	2d19755779	Refactoring of robotparser-rs (#20) ... * Migrated sites into robotsparser file. * Robots.txt refactoring. * Migrated to new version of url and reqwest.	2020-01-31 17:00:58 +08:00
messense	cb7df85b83	Bump version to 0.10.2	2018-09-22 11:47:15 +08:00
messense	2205ef3b5d	Remove clippy for now	2018-09-22 11:33:28 +08:00
Laurent Arnoud	13e60c226a	Update reqwest to 0.9 (#16)	2018-09-22 11:30:41 +08:00
messense	9d46f5ac99	Bump version to 0.10.1	2018-03-12 09:29:22 +08:00
messense	6adf740663	Use url crate 1.x version	2018-01-11 11:28:52 +08:00
messense	d6127d25bb	Bump version to 0.10.0	2017-12-02 23:52:48 +08:00
Laurent Arnoud	79471efcc2	Update reqwest to 0.8	2017-12-02 16:39:25 +01:00
messense	8fdbd92042	Bump version to 0.9.0	2017-08-09 13:17:06 +08:00
messense	44eb658238	Upgrade reqwest to 0.7	2017-08-09 13:16:27 +08:00
messense	9f57b38e02	Bump version to 0.8.2	2017-04-02 00:05:43 +08:00
messense	b4b0752e96	Upgrade reqwest to 0.5	2017-04-02 00:05:16 +08:00
messense	cd4d32bf28	Bump version to 0.8.1	2017-03-13 23:10:57 +08:00
Laurent Arnoud	be7f58adec	Less strict version on reqwest ... Using MINOR from semver	2017-03-12 15:03:38 +01:00
messense	101f926adc	Bump version to 0.8.0	2016-11-14 16:14:40 +08:00
Laurent Arnoud	9f5b4c27d4	Use request higher level Client crate for openssl updates ... see https://github.com/hyperium/hyper/issues/907#issuecomment-255509020	2016-11-12 18:22:55 +01:00
messense	29c009114c	Bump version to 0.7.0	2016-10-05 13:30:10 +08:00
messense	8ede3b4218	Feature gate hyper	2016-10-02 13:17:15 +08:00
messense	6bebf15aca	Bump version to 0.6.0	2016-08-25 20:30:12 +08:00
messense	d0351ecd2a	Bump version to 0.5.0	2016-08-21 21:52:53 +08:00
Laurent Arnoud	e3663eb257	Use std::time instead of deprecated crate time	2016-08-20 20:24:40 +02:00
messense	cc9a9c91d9	Bump version to 0.4.4	2016-05-05 09:32:50 +08:00
messense	77b604d2af	Bump version to 0.4.3 ... Signed-off-by: messense <messense@icloud.com>	2016-04-25 12:33:15 +08:00
messense	b6c9242db8	Upgrade to hyper 0.8	2016-03-17 13:21:51 +08:00
messense	2d9c028dfa	Refactor codes like clippy suggested	2016-03-06 16:19:58 +08:00
messense	7bbe96d096	Merge branch 'master' of github.com:messense/robotparser-rs ... Conflicts: Cargo.toml	2016-02-08 19:54:29 +08:00
Mikhail Svetov	626fa947e4	Added sitemap support.	2016-02-08 17:23:46 +07:00
messense	119f067b1e	Lock dependencies version to minor	2016-01-14 09:29:27 +08:00
Mikhail Svetov	f6168c3ea2	Changed version.	2016-01-13 20:53:33 +07:00
messense	04c25dda65	Bump version to 0.2.0	2015-10-21 15:40:44 +08:00
messense	e27e17589c	Remove illegal keyword robots.txt from Cargo.toml	2015-07-01 00:20:50 +08:00
messense	41351bc68f	Update package metadata	2015-07-01 00:04:39 +08:00
messense	ece1e1f3c4	Initial commit.	2015-06-28 01:29:05 +08:00