mirror of
https://github.com/danbulant/robotparser-rs
synced 2026-05-22 22:09:06 +00:00
* Add test when url is invalid and panic * Initial error handling ref https://github.com/messense/robotparser-rs/issues/22 * Rename ErrorKind::HttpClient => ErrorKind::Http * Implement std::error::Error and rename to Error |
||
|---|---|---|
| .. | ||
| clean_params.rs | ||
| errors.rs | ||
| fetched_robots_txt.rs | ||
| group.rs | ||
| path.rs | ||
| path_pattern.rs | ||
| request_rate.rs | ||
| robots_txt.rs | ||
| rule.rs | ||