dan/robotparser-rs
1
0
Fork 0
mirror of https://github.com/danbulant/robotparser-rs synced 2026-05-19 12:29:49 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Commit graph

  • dd658cfc47
         gate errors module behind reqwest master Daniel Bulant 2025-08-31 14:29:18 +0200
  • 165de042c4
         update reqwest version Daniel Bulant 2025-08-31 14:23:32 +0200
  • e889cf1855
         fix reqwest feature being mandatory Daniel Bulant 2025-08-31 14:21:14 +0200
  • ec7b2fd986
         Fix some more clippy warnings messense 2022-03-30 10:21:52 +0800
  • 6db945c28f
         Fix a clippy warning messense 2022-03-30 10:18:13 +0800
  • 548ea65072
         Update reqwest to 0.11 messense 2022-03-30 10:15:35 +0800
  • 70384a5fbf Remove CI cache messense 2020-11-03 19:05:43 +0800
  • abcb18dc97
         Add support coverage via codecov + tarpaulin (#31) Maxim Zhukov 2020-11-03 14:04:47 +0300
  • 230c4201ca
         cargo: update (#30) Maxim Zhukov 2020-11-03 13:26:28 +0300
  • e7b82b7079
         parser: replace manual strip with trim_start_matches (#29) Maxim Zhukov 2020-11-03 13:26:14 +0300
  • 9bb7583f30
         README: remove old rust instructions (#28) Maxim Zhukov 2020-11-03 13:25:55 +0300
  • 408f792ebd Commit Cargo.lock to git for cache to actually work messense 2020-03-30 09:42:35 +0800
  • 5861623b6b Rename workflow name to CI messense 2020-03-30 09:38:53 +0800
  • 85c108ef43 Remove Travis & Appveyor messense 2020-03-30 09:36:57 +0800
  • 6ba403aab9
         Inital github-actions (#25) Laurent Arnoud 2020-03-30 01:32:32 +0000
  • df49f6bcf0
         Error handling (#24) Laurent Arnoud 2020-03-08 12:33:34 +0000
  • 1474a8cce9
         Switch to https for urls (#23) Laurent Arnoud 2020-03-02 07:20:44 +0000
  • 2d19755779
         Refactoring of robotparser-rs (#20) svmk 2020-01-31 16:00:58 +0700
  • cb7df85b83 Bump version to 0.10.2 messense 2018-09-22 11:47:15 +0800
  • 86a483be75 Use openssl 1.0.2p on Appveyor messense 2018-09-22 11:44:43 +0800
  • 2205ef3b5d Remove clippy for now messense 2018-09-22 11:33:28 +0800
  • 13e60c226a Update reqwest to 0.9 (#16) Laurent Arnoud 2018-09-22 05:30:41 +0200
  • ed0f892875
         Use openssl 1.0.2o open AppVeyor messense 2018-04-02 13:17:33 +0800
  • 141109aa15 Add deps status badge (#15) Laurent Arnoud 2018-04-02 04:31:34 +0200
  • 9d46f5ac99
         Bump version to 0.10.1 messense 2018-03-12 09:29:22 +0800
  • 4688c72346
         Merge pull request #14 from spk/fix-127.0.0.1-host-panic messense 2018-03-12 09:23:09 +0800
  • 19bd3b4cf6
         Use host_str instead domain for HostInternal Laurent Arnoud 2018-03-11 22:05:14 +0100
  • 953d1f0c0b
         Again fix AppVeyor messense 2018-01-11 13:43:24 +0800
  • 6854290e18
         Use openssl 1.0.2n on Appveyor messense 2018-01-11 12:31:40 +0800
  • 6adf740663
         Use url crate 1.x version messense 2018-01-11 11:28:52 +0800
  • d6127d25bb
         Bump version to 0.10.0 messense 2017-12-02 23:52:48 +0800
  • 5ad2785e07
         Fix some clippy warnings messense 2017-12-02 23:51:52 +0800
  • 3b24290e5c
         Appveyor use openssl 1.0.2m messense 2017-12-02 23:49:41 +0800
  • 450cafadfd
         Merge pull request #13 from spk/update-request messense 2017-12-02 23:47:59 +0800
  • 79471efcc2
         Update reqwest to 0.8 Laurent Arnoud 2017-12-02 16:39:25 +0100
  • 832eb63e36
         Update doc refs version messense 2017-08-09 13:21:28 +0800
  • 8fdbd92042
         Bump version to 0.9.0 messense 2017-08-09 13:17:06 +0800
  • 44eb658238
         Upgrade reqwest to 0.7 messense 2017-08-09 13:16:27 +0800
  • 63016cd97a
         Update version to 0.8 in docs messense 2017-04-02 00:08:43 +0800
  • 9f57b38e02
         Bump version to 0.8.2 messense 2017-04-02 00:05:43 +0800
  • b4b0752e96
         Upgrade reqwest to 0.5 messense 2017-04-02 00:05:16 +0800
  • cd4d32bf28
         Bump version to 0.8.1 messense 2017-03-13 23:10:57 +0800
  • b27c5544eb Merge pull request #12 from spk/less-strict-reqwest-vers messense 2017-03-12 22:11:27 +0800
  • 426365bc9d
         Set RUST_BACKTRACE=1 on Travis CI messense 2017-03-12 22:10:33 +0800
  • be7f58adec
         Less strict version on reqwest Laurent Arnoud 2017-03-12 15:03:38 +0100
  • 101f926adc
         Bump version to 0.8.0 messense 2016-11-14 16:14:40 +0800
  • e3b9ca6c6b Merge pull request #11 from spk/use-request-http-client messense 2016-11-14 16:10:18 +0800
  • 9f5b4c27d4
         Use request higher level Client crate for openssl updates Laurent Arnoud 2016-11-12 18:15:22 +0100
  • a94a5b34cc
         Replace 0.6 with 0.7 in README and docstring messense 2016-10-21 14:39:08 +0800
  • 29c009114c
         Bump version to 0.7.0 messense 2016-10-05 13:30:10 +0800
  • 760a4e723b Merge pull request #10 from messense/feature/feature-gate-hyper messense 2016-10-05 13:28:45 +0800
  • 66661fda1e
         Upgrade Win32 OpenSSL on Appveyor CI messense 2016-10-05 10:50:22 +0800
  • 8ede3b4218
         Feature gate hyper messense 2016-10-02 13:17:15 +0800
  • 7e3a47b7f2
         Update version in README and documentation messense 2016-08-25 20:38:05 +0800
  • 6bebf15aca
         Bump version to 0.6.0 messense 2016-08-25 20:30:12 +0800
  • c32933db75 Merge pull request #8 from messense/feature/from-response-mutability messense 2016-08-25 18:22:03 +0800
  • 553b47f7e7
         Change from_response method signature messense 2016-08-25 18:01:17 +0800
  • 96a6593723 Merge pull request #7 from ernestas-poskus/features/add_method_read_from_response messense 2016-08-25 17:52:49 +0800
  • 36c90ec169 Add method read_from_response Ernestas Poskus 2016-08-24 23:37:47 +0300
  • d0351ecd2a Bump version to 0.5.0 messense 2016-08-21 21:52:53 +0800
  • a732ad5085 Merge pull request #6 from messense/request-rate messense 2016-08-21 21:42:27 +0800
  • 17a36159a7 Add Request-rate support. Closes #4 messense 2016-08-21 11:35:24 +0800
  • 384ae57caa Add .vscode/ to .gitignore messense 2016-08-21 11:00:21 +0800
  • a5254dbc52 style: rustfmt source codes messense 2016-08-21 10:58:18 +0800
  • e501f4c3b9 Merge pull request #5 from spk/remove-crate-time messense 2016-08-21 10:13:51 +0800
  • e3663eb257
         Use std::time instead of deprecated crate time Laurent Arnoud 2016-08-20 20:21:33 +0200
  • f43b2eb28e
         Upgrade to OpenSSL-1.0.2h open AppVeyor CI messense 2016-05-05 09:34:53 +0800
  • cc9a9c91d9 Bump version to 0.4.4 messense 2016-05-05 09:32:50 +0800
  • 5b3d3ea305 Merge pull request #3 from spk/set-user-agent messense 2016-05-05 09:26:15 +0800
  • 8b50c90f94
         Set UserAgent as robotparser-rs Laurent Arnoud 2016-05-04 23:43:32 +0200
  • caca158589 Use Cow instead of owned String messense 2016-04-27 11:26:28 +0800
  • 4862c704ad Fix Start-FileDownload messense 2016-04-25 16:47:21 +0800
  • 8158a38cd8
         Update appveyor.yml messense 2016-04-25 16:40:45 +0800
  • 4e580ae3ee
         Update appveyor OpenSSL download link messense 2016-04-25 16:30:44 +0800
  • a552d99210
         Do not deny all clippy issues messense 2016-04-25 13:23:01 +0800
  • 77b604d2af
         Bump version to 0.4.3 messense 2016-04-25 12:33:15 +0800
  • 74fddfd5cb Add implementation of Default for Entry messense 2016-03-17 13:29:58 +0800
  • b6c9242db8 Upgrade to hyper 0.8 messense 2016-03-17 13:21:51 +0800
  • 7f9d08b307 Better documentation messense 2016-03-06 16:31:44 +0800
  • 2d9c028dfa Refactor codes like clippy suggested messense 2016-03-06 16:19:58 +0800
  • 7bbe96d096 Merge branch 'master' of github.com:messense/robotparser-rs messense 2016-02-08 19:54:29 +0800
  • a18dcd4c26 Merge pull request #2 from svmk/master messense 2016-02-08 19:37:19 +0800
  • fcfb6d9df6 Improvements. Mikhail Svetov 2016-02-08 17:25:27 +0700
  • 626fa947e4 Added sitemap support. Mikhail Svetov 2016-02-08 17:23:46 +0700
  • 119f067b1e Lock dependencies version to minor messense 2016-01-14 09:29:27 +0800
  • 255166313f Merge pull request #1 from svmk/master messense 2016-01-14 09:27:22 +0800
  • 02eedd6246 Improvements. Mikhail Svetov 2016-01-13 21:18:07 +0700
  • f6168c3ea2 Changed version. Mikhail Svetov 2016-01-13 20:53:33 +0700
  • 49a2b9c93d Added crawl delay feature. Mikhail Svetov 2016-01-13 20:51:54 +0700
  • 04c25dda65 Bump version to 0.2.0 messense 2015-10-21 15:40:44 +0800
  • ac7d7aa8db Refactor some API to be more generic over Rust strings messense 2015-10-21 15:40:06 +0800
  • 685853e729 Update .travis.yml to test on Rust stable messense 2015-09-22 09:47:54 +0800
  • 160ed940ae Use join instead of connect messense 2015-08-12 17:53:28 +0800
  • 8c20000a47 Windows CI build fix again messense 2015-07-05 00:10:51 +0800
  • b23797ef26 Try to fix OpenSSL issue on Windows CI messense 2015-07-04 23:58:03 +0800
  • 1b09968d3a Remove Rust stable from test env messense 2015-07-04 23:48:00 +0800
  • abe10abd9a Update CI configurations messense 2015-07-04 23:43:25 +0800
  • 179d6e5f87 Update README.md messense 2015-07-04 23:43:10 +0800
  • cbe515e761 Add RobotFileParser.read test case messense 2015-07-01 10:23:07 +0800
  • e27e17589c Remove illegal keyword robots.txt from Cargo.toml messense 2015-07-01 00:20:50 +0800