stupid_crawler 0.2.1

Stupid crawler that looks for URLs on a given site. Result is saved as two CSV files one with found URLs and another with failed URLs.

Gemfile:
=

install:
=

Versions:

0.2.1 September 10, 2017 (8 KB)
0.2.0 September 10, 2017 (8 KB)

Runtime Dependencies (1):

spidr ~> 0.6

Development Dependencies (2):

bundler ~> 1.12

rake ~> 10.0

Show all transitive dependencies

Owners:

Authors:

Jacob Burenstam

SHA 256 checksum:

=