mirror of
https://github.com/internetarchive/heritrix3.git
synced 2026-07-16 20:47:15 +00:00
1ce23ecbcd
[HER-1768] Changing queue totalBudget not retiring queue as expected
* CrawlURI.java
(includesRetireDirective) internalize to CrawlURI
* AbstractFrontier.java
allow re-enqueuing of untried URI with retire-driective
clean up terminology/method-names
* WorkQueue.java, WorkQueueFrontier.java, BdbFrontier.java
adjust budget/sessionBalance handling to always count up, always consult latest values, always refresh values from latest URI
(processFinish) reorganize to reduce redundancy
* DispositionProcessor.java
offer forceRetire setting
* QuotaEnforcer.java
set failed-status *or* forceRetire, not both
[HER-1823] H3: adding SheetAssociations mid-crawl won't affect already queued CrawlURIs (sheet liveness)
* SheetsOverlayManager.java
(applyOverlaysTo) rename, unify, reapply whenever called to ensure liveness
* CandidatesProcessor.java
adjust to rename