AbotX Web Crawler 1.3.73 Ultimate
A powerful C# web crawler that makes advanced crawling features easy to use. AbotX builds upon the open source Abot C# Web Crawler by providing a powerful set of wrappers and extensions.
Crawl multiple sites concurrently
Pause/resume live crawls
Avoid getting blocked by sites
Automatically tune speed/concurrency