Crawler - starts from a given URL and follows the links

This package provides Cocoon crawler components.

A crawler component crawls through URLs. The process is initiated by calling crawl(). The method iterator() returns an Iterator object. This Iterator object iterates over all URLs reachable from the passed URL of method crawl().