gojomo 99a49b2df7 Avoid treating temporarily-DEFERRED robots.txt handling as-if a failure-to-ignore in robots-ignored case ...

* DispositionProcessor
    treat S_DEFERRED different from other negative error statuses

2011-05-27 01:24:49 +00:00

..

design

…

main

Avoid treating temporarily-DEFERRED robots.txt handling as-if a failure-to-ignore in robots-ignored case

2011-05-27 01:24:49 +00:00

test/java/org/archive/crawler

Use Recorder.getContentReplayCharSequence() instead of deprecated

2011-04-20 19:38:12 +00:00

webapps/selftest

…

xsd/arc/1.0

…