Rawler is a Ruby library that crawls your website and checks the status code for each of your links. Useful for finding dead links. Rawler will only parse pages with content type 'text/html', but it will check for the response code of every link. Please note: I had to temporarily remove url encoding in order to resolve some issues, so if you find any issue, please let me know. I'm also going to use Mechanizer for parsing pages with the next release.
Required Ruby Version
None
Authors
Oscar Del Ben
Versions
- 0.1.8 September 07, 2013 (21 KB)
- 0.1.7 December 02, 2012 (21 KB)
- 0.1.6 July 17, 2012 (20.5 KB)
- 0.1.5 April 14, 2012 (20 KB)
- 0.1.4 February 27, 2012 (20 KB)
- 0.0.5 January 20, 2011 (17.5 KB)