dan/robotparser-rs
1
0
Fork 0
mirror of https://github.com/danbulant/robotparser-rs synced 2026-05-19 04:18:42 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

parser: replace manual strip with trim_start_matches (#29)

Browse source 
Signed-off-by: Maxim Zhukov <mussitantesmortem@gmail.com>
This commit is contained in:
Maxim Zhukov 2020-11-03 13:26:14 +03:00 committed by GitHub
parent 9bb7583f30
commit e7b82b7079
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 4 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
src/parser/robots_txt_parser.rs
View file

@ -267,8 +267,5 @@ impl Parser {
fn ignore_bom(input: &str) -> &str {
const BOM: &str = "\u{feff}";
if input.starts_with(BOM) {
return &input[BOM.len()..];
}
input
input.trim_start_matches(BOM)
}