heritrix3

mirror of https://github.com/internetarchive/heritrix3.git synced 2026-07-16 12:37:11 +00:00

T

gojomo 1ce23ecbcd [HER-747] Ensure 'retired' status for queues is operator-controllable

[HER-1768] Changing queue totalBudget not retiring queue as expected
* CrawlURI.java
    (includesRetireDirective) internalize to CrawlURI
* AbstractFrontier.java
    allow re-enqueuing of untried URI with retire-driective
    clean up terminology/method-names
* WorkQueue.java, WorkQueueFrontier.java, BdbFrontier.java
    adjust budget/sessionBalance handling to always count up, always consult latest values, always refresh values from latest URI
    (processFinish) reorganize to reduce redundancy
* DispositionProcessor.java
    offer forceRetire setting
* QuotaEnforcer.java
    set failed-status *or* forceRetire, not both
[HER-1823] H3: adding SheetAssociations mid-crawl won't affect already queued CrawlURIs (sheet liveness) 
* SheetsOverlayManager.java
    (applyOverlaysTo) rename, unify, reapply whenever called to ensure liveness
* CandidatesProcessor.java
    adjust to rename

2010-09-21 10:55:07 +00:00

.settings

commit project-specific eclipse settings

2009-11-11 02:05:30 +00:00

commons

[HER-1727] (W)ARC filename uniqueness guarantees: adminport option, process_id option(?), JVM-global-repeat-suppression

2010-09-20 13:51:13 +00:00

dist

[HER-1803] H3: make it easier to change robots settings

2010-09-10 00:27:20 +00:00

engine

[HER-747] Ensure 'retired' status for queues is operator-controllable