Heritrix is a scalable, open-source web crawler designed for large-scale, high-performance web...