gojomo 881c829fe5 Checkpoint fixes/improvements ...

* BdbModule
    store lengths in JDB manifest; limit extension of last JDB on recover
* CrawlerJournal
    rotate frontier-recover on checkpoints like other logs

2010-11-15 22:37:58 +00:00

.settings

commit project-specific eclipse settings

2009-11-11 02:05:30 +00:00

commons

Checkpoint fixes/improvements

2010-11-15 22:37:58 +00:00

dist

remove outdated adler32 workaround

2010-11-05 22:42:27 +00:00

engine

Improve ability to force-terminate crawls

2010-11-15 22:26:36 +00:00

modules

Consolidate ModuleAttributeConstants into CoreAttributeConstants

2010-11-09 23:47:37 +00:00

.classpath

Minimize transient garbage volume by optimized serialization based on the 'Kryo' library

2010-11-05 23:23:58 +00:00

.project

Fix for [HER-1524] speculativeFixup in ExtractorJS should maintain URL scheme

2009-05-12 22:09:22 +00:00

java.hprof.txt

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

java.hprof.txt-cpusamples

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

java.hprof.txt-heapsites

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

pom.xml

[HER-1831] change version numbering convention to be less confusing

2010-09-30 19:48:35 +00:00

S

Description

No description provided

heritrixjavawarcwebcrawling

14 MiB

Languages

Java 93.3%

HTML 2.6%

Rich Text Format 1.1%

JavaScript 1%

FreeMarker 0.8%

Other 1%