cobweb 1.0.25

Cobweb is a web crawler that can use resque to cluster crawls to quickly crawl extremely large sites which is much more performant than multi-threaded crawlers. It is also a standalone crawler that has a sophisticated statistics monitoring interface to monitor the progress of the crawls.

Gemfile:
=

instalar:
=

Versões:

1.2.1 - January 09, 2021 (9,28 MB)
1.2.0 - February 25, 2019 (9,28 MB)
1.1.0 - November 06, 2015 (9,28 MB)
1.0.29 - November 05, 2015 (9,28 MB)
1.0.28 - March 20, 2015 (9,28 MB)
1.0.25 - January 24, 2015 (9,28 MB)

Mostrar todas as versões (94)

Runtime Dependencies (9):

addressable >= 0

awesome_print >= 0

haml >= 0

json >= 0

nokogiri >= 0

redis >= 0

redis-namespace >= 0

sinatra >= 0

slop ~> 3.4

Mostrar todas as dependências

Donos:

Autores:

Stewart McKee

cobweb 1.0.25

Gemfile:
=

instalar:
=

Versões:

Runtime Dependencies (9):

Donos:

Autores:

SHA 256 checksum:

Total de downloads 330.929

Desta versão 3.117

Versão lançada:
January 24, 2015 11:52am

Licença:
MIT

Versão Requerida do Ruby: >= 0

Links:

cobweb 1.0.25

Gemfile: =

instalar: =

Versões:

Runtime Dependencies (9):

Donos:

Autores:

SHA 256 checksum:

Total de downloads 330.929

Desta versão 3.117

Versão lançada: January 24, 2015 11:52am

Licença: MIT

Versão Requerida do Ruby: >= 0

Links:

Gemfile:
=

instalar:
=

Versão lançada:
January 24, 2015 11:52am

Licença:
MIT