gojomo 99a49b2df7 Avoid treating temporarily-DEFERRED robots.txt handling as-if a failure-to-ignore in robots-ignored case ...

* DispositionProcessor
    treat S_DEFERRED different from other negative error statuses

2011-05-27 01:24:49 +00:00

..

src

Avoid treating temporarily-DEFERRED robots.txt handling as-if a failure-to-ignore in robots-ignored case

2011-05-27 01:24:49 +00:00

testdata/selftest

[HER-1803] H3: make it easier to change robots settings

2010-09-10 00:27:20 +00:00

.classpath

copy 'springy' branch to heritrix3

2009-05-11 22:56:36 +00:00

.cvsignore

copy 'springy' branch to heritrix3

2009-05-11 22:56:36 +00:00

.project

copy 'springy' branch to heritrix3

2009-05-11 22:56:36 +00:00

pom.xml

Post 3.1.0-beta

2011-04-15 22:28:52 +00:00