nlevitt e2f29992d4 Put hard limit of 5 on seed redirects being treated as new seeds, to avoid ...

endless recrawling of the same url(s) in case of a redirect loop.  
* CandidatesProcessor.java

2011-07-23 02:20:35 +00:00

.settings

commit project-specific eclipse settings

2009-11-11 02:05:30 +00:00

commons

Reduce redundant Pattern instance caching

2011-07-20 23:04:26 +00:00

dist

Post 3.1.0-beta

2011-04-15 22:28:52 +00:00

engine

Put hard limit of 5 on seed redirects being treated as new seeds, to avoid

2011-07-23 02:20:35 +00:00

modules

[HER-1912] Kryo-deserialization of Robotstxt can consume excess memory by creating multiple copies of RobotsDirective

2011-07-22 06:46:39 +00:00

.classpath

[HER-1908] H3: upgrade to Spring 3

2011-07-08 04:31:54 +00:00

.project

Fix for [HER-1524] speculativeFixup in ExtractorJS should maintain URL scheme

2009-05-12 22:09:22 +00:00

java.hprof.txt

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

java.hprof.txt-cpusamples

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

java.hprof.txt-heapsites

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

pom.xml

Post 3.1.0-beta

2011-04-15 22:28:52 +00:00

S

Description

No description provided

heritrixjavawarcwebcrawling

14 MiB

Languages

Java 93.3%

HTML 2.6%

Rich Text Format 1.1%

JavaScript 1%

FreeMarker 0.8%

Other 1%