RubyGems Navigation menu

link_scraper 2.0

Scrape website links' text and path with built-in scrubbing filter. Designed to rapidly visit and scrape links from list of several URLs, then filters them based on your criteria. For example, to only grab the links for inventory, staff, or contact us, etc.

Gemfile:
=

install:
=

Versions:

  1. 2.1 July 11, 2018 (14 KB)
  2. 2.0 July 10, 2018 (14 KB)
  3. 1.02 July 04, 2018 (14 KB)
  4. 1.01 July 04, 2018 (10.5 KB)

Runtime Dependencies (5):

activesupport ~> 5.2
crm_formatter ~> 2.65
mechanizer ~> 1.12
scrub_db ~> 2.24
url_verifier ~> 2.12

Development Dependencies (4):

bundler >= 1.16.2, ~> 1.16
pry ~> 0.11.3
rake >= 12.3.1, ~> 12.3
rspec ~> 3.7

Owners:

Authors:

  • Adam Booth

SHA 256 checksum:

=

Total downloads 6,922

For this version 1,603

Version Released:

License:

MIT

Required Ruby Version: ~> 2.5.1

Links: