RubyGems Navigation menu

arachnid 0.4.1

Arachnid is a web crawler that relies on Bloom Filters to efficiently store visited urls and Typhoeus to avoid the overhead of Mechanize when crawling every page on a domain.

Gemfile:
=

安装:
=

版本列表:

  1. 0.4.1 January 17, 2014 (5.0 KB)
  2. 0.4.0 January 16, 2014 (4.5 KB)
  3. 0.3.2 January 16, 2014 (5.0 KB)
  4. 0.3.1 January 16, 2014 (5.0 KB)
  5. 0.3.0 January 16, 2014 (4.5 KB)
显示所有版本 (共 12 个)

Runtime 依赖 (4):

bloomfilter-rb = 2.1.1
nokogiri = 1.5.0
typhoeus = 0.3.2

业主:

作者:

  • dchuk

SHA 256 校验和:

=

下载总量 50,085

这个版本 4,574

版本发布:

许可:

需要的 Ruby 版本:

链接: