cobweb 1.0.16

Cobweb is a web crawler that can use resque to cluster crawls to quickly crawl extremely large sites which is much more performant than multi-threaded crawlers. It is also a standalone crawler that has a sophisticated statistics monitoring interface to monitor the progress of the crawls.

Gemfile:
=

instalar:
=

Versões:

1.2.1 January 09, 2021 (9,28 MB)
1.2.0 February 25, 2019 (9,28 MB)
1.1.0 November 06, 2015 (9,28 MB)
1.0.29 November 05, 2015 (9,28 MB)
1.0.28 March 20, 2015 (9,28 MB)
1.0.16 August 22, 2013 (9,28 MB)

Mostrar todas as versões (94)

Runtime Dependencies (11):

addressable >= 0

awesome_print >= 0

haml >= 0

json >= 0

namespaced_redis >= 0

nokogiri >= 0

redis >= 0

rspec >= 0

sinatra >= 0

slop >= 0

thin >= 0

Mostrar todas as dependências

Donos:

Autores:

Stewart McKee

cobweb 1.0.16

Gemfile:
=

instalar:
=

Versões:

Runtime Dependencies (11):

Donos:

Autores:

SHA 256 checksum:

Total de downloads 332.361

Desta versão 3.152

Versão lançada:
August 22, 2013 3:30pm

Licença:
MIT

Versão Requerida do Ruby: Nenhum

Links:

cobweb 1.0.16

Gemfile: =

instalar: =

Versões:

Runtime Dependencies (11):

Donos:

Autores:

SHA 256 checksum:

Total de downloads 332.361

Desta versão 3.152

Versão lançada: August 22, 2013 3:30pm

Licença: MIT

Versão Requerida do Ruby: Nenhum

Links:

Gemfile:
=

instalar:
=

Versão lançada:
August 22, 2013 3:30pm

Licença:
MIT