mirror of
https://github.com/internetarchive/heritrix3.git
synced 2026-11-22 13:47:02 +00:00
Add S_MIDFETCH_ABORTED (-5005) and set it in FetchHTTP when shouldFetchBodyRule rejects a response, in place of S_OUT_OF_SCOPE. The code means something distinct from a scope rejection, so crawl logs and reports can now tell the two apart. AbstractFrontier.isDisregarded() treats it as disregarded, CrawlURI gives it a readable string and the glossary lists it.
Heritrix Documentation
This directory contains structured documentation we're in the process of migrating and reformatting. It can be viewed online.
The main bulk of Heritrix's documentation currently lives on the Github wiki.