nlevitt ada8cbd198 Fix bug reported by Travis where in certain corner cases where urls are processed in a particular order, a seed can be incorrectly tagged with S_ROBOTS_PREREQUISITE_FAILURE ...

* DispositionProcessor.java
    innerProcess() - do not update server's robots info if robots fetch has been deferred

2011-08-04 01:32:09 +00:00

.settings

commit project-specific eclipse settings

2009-11-11 02:05:30 +00:00

commons

Fix HER-1913 cookies not being sent

2011-07-26 19:07:26 +00:00

dist

Post 3.1.0-RC1

2011-07-26 03:42:02 +00:00

engine

Fix bug reported by Travis where in certain corner cases where urls are processed in a particular order, a seed can be incorrectly tagged with S_ROBOTS_PREREQUISITE_FAILURE

2011-08-04 01:32:09 +00:00

modules

Fix handling of server error on robots.txt - change to what appears to be the intended behavior

2011-08-02 23:28:20 +00:00

.classpath

* .classpath

2011-07-25 21:53:50 +00:00

.project

Fix for [HER-1524] speculativeFixup in ExtractorJS should maintain URL scheme

2009-05-12 22:09:22 +00:00

java.hprof.txt

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

java.hprof.txt-cpusamples

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

java.hprof.txt-heapsites

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

pom.xml

Post 3.1.0-RC1

2011-07-26 03:42:02 +00:00

S

Description

No description provided

heritrixjavawarcwebcrawling

16 MiB

0 Stars 1 Watchers 0 Forks

Languages

Java 93.6%

HTML 2.4%

Rich Text Format 1%

JavaScript 1%

FreeMarker 0.8%

Other 1%