A Web spidering library: handles robots.txt, scraping, finding more links, and doing it all over again.
Required Ruby Version
> 0.0.0
Authors
Mike Burns
Versions
- 0.8.0 July 06, 2026 (10 KB)
- 0.7.0 September 08, 2025 (10 KB)
- 0.6.0 September 08, 2025 (10 KB)
- 0.5.4 June 04, 2020 (15.5 KB)
- 0.5.3 April 23, 2018 (15 KB)
- 0.4.1 November 10, 2007This gem version was imported to RubyGems.org on July 25, 2009. The date displayed was specified by the author in the gemspec. (19.5 KB)