JSpider is:

  • A highly configurable and customizable Web Spider engine.
  • Developed under the LGPL Open Source license
  • In 100% pure Java

You can use it to:

  • Check your site for errors (internal server errors, ...)
  • Outgoing and/or internal link checking
  • Analyze your site structure (creating a sitemap, ...)
  • Download complete web sites
  • Any task you want, if you write a JSpider plugin.

URL: http://j-spider.sourceforge.net/
Licence: LGPL