stupid_crawler 0.2.1
Stupid crawler that looks for URLs on a given site. Result is saved as two CSV files one with found URLs and another with failed URLs.
Gemfile:
=
instalar:
=
Runtime Dependencies (1):
spidr
~> 0.6