Skip to content

0.4.0

Pre-release
Pre-release

Choose a tag to compare

View all tags
@Turnerj Turnerj released this 13 Jun 16:33
0.4.0
6739930
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Add case insensitivity for field names (eg. "User-agent") (#34, #35)
Performance optimizations (~15% faster, ~20% less allocations)

Note: There are some breaking changes around tokenization. If you're extending this library, pay attention to fb0ebb5 and c27d0fc.

If you just use the RobotsFileParser or RobotsPageParser classes, you shouldn't notice any changes.

Assets 4
Loading