RubyGems Navigation menu

spider 0.4.1

A Web spidering library: handles robots.txt, scraping, finding more links, and doing it all over again.

Gemfile:
=

install:
=

Versions:

  1. 0.7.0 September 08, 2025 (10 KB)
  2. 0.6.0 September 08, 2025 (10 KB)
  3. 0.5.4 June 04, 2020 (15.5 KB)
  4. 0.5.3 April 23, 2018 (15 KB)
  5. 0.5.2 April 23, 2018 (15 KB)
  6. 0.4.1 November 10, 2007* (19.5 KB)
Show all versions (16 total)

Owners:

Authors:

  • Mike Burns

SHA 256 checksum:

=
← Previous version Next version →

Total downloads 489,391

For this version 3,780

Version Released:

Licenses:

N/A

Required Ruby Version: > 0.0.0

Links:

Homepage Download Review changes Badge Subscribe RSS Analytics Report abuse Reverse dependencies