- A highly configurable and customizable Web Spider engine.
- Developed under the LGPL Open Source license
- In 100% pure Java
You can use it to:
- Check your site for errors (internal server errors, ...)
- Outgoing and/or internal link checking
- Analyze your site structure (creating a sitemap, ...)
- Download complete web sites
- Any task you want, if you write a JSpider plugin.