nlevitt ef9d2e8c0e [HER-1789] stats from WARCWriterProcessor ...

* WriterPoolMember.java
    write(*), copyFrom() - return number of (uncompressed) bytes written, for
    convenience
* WARCWriter.java
    tally by record type: number of records written, content bytes, total
    bytes, and (possibly compressed) size on disk
* WARCWriterProcessor.java
    keep totals and write report to processors-report.txt

2011-01-12 00:54:01 +00:00

.settings

commit project-specific eclipse settings

2009-11-11 02:05:30 +00:00

commons

[HER-1789] stats from WARCWriterProcessor

2011-01-12 00:54:01 +00:00

dist

Part of HER-1857. Rename textSource->surtsSource, and make old surtsSourceFile

2011-01-11 20:42:05 +00:00

engine

[HER-1858] H3: frontier futureUris (rescheduling) unreliable for otherwise empty frontier/queue

2011-01-12 00:21:40 +00:00

modules

[HER-1789] stats from WARCWriterProcessor

2011-01-12 00:54:01 +00:00

.classpath

* .classpath

2010-12-03 01:30:28 +00:00

.project

Fix for [HER-1524] speculativeFixup in ExtractorJS should maintain URL scheme

2009-05-12 22:09:22 +00:00

java.hprof.txt

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

java.hprof.txt-cpusamples

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

java.hprof.txt-heapsites

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

pom.xml

[HER-1831] change version numbering convention to be less confusing

2010-09-30 19:48:35 +00:00

S

Description

No description provided

heritrixjavawarcwebcrawling

15 MiB

Languages

Java 93.3%

HTML 2.6%

Rich Text Format 1%

JavaScript 1%

FreeMarker 0.8%

Other 1.1%