gort 0.1.0
robots.txt parser and evaluator according to RFC 9309.
Gemfile:
=
instalar:
=
dependencias de Runtime (2):
addressable
~> 2.8
rchardet
~> 1.8