nlevitt e9d53ec487 HER-1791 - a different implementation ...

* IdenticalDigestDecideRule.java
    fix javadoc typo
* CoreAttributeConstants.java
    "history-good-to-store" is history
* RecrawlAttributeConstants.java
    new "write-tag" constant
* PersistProcessor.java
    remove defunct "history-good-to-store" logic; nadd new option onlyStoreIfWriteTagPresent, and update shouldStore() to respect that option
* WriterPoolProcessor.java
    remove defunct "history-good-to-store" logic; new method copyForwardWriteTagIfDupe(); override innerRejectProcess() to call copyForwardWriteTagIfDupe()
* ARCWriterProcessor.java, WARCWriterProcessor.java
    remove defunct "history-good-to-store" logic; add writeTag to history on write; call copyForwardWriteTagIfDupe() on skipIdenticalDigest

2011-07-18 20:22:48 +00:00

.settings

commit project-specific eclipse settings

2009-11-11 02:05:30 +00:00

commons

* ConfigPathConfigurer

2011-07-16 17:49:11 +00:00

dist

Post 3.1.0-beta

2011-04-15 22:28:52 +00:00

engine

* CrawlJob.java

2011-07-16 00:48:14 +00:00

modules

HER-1791 - a different implementation

2011-07-18 20:22:48 +00:00

.classpath

[HER-1908] H3: upgrade to Spring 3

2011-07-08 04:31:54 +00:00

.project

Fix for [HER-1524] speculativeFixup in ExtractorJS should maintain URL scheme

2009-05-12 22:09:22 +00:00

java.hprof.txt

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

java.hprof.txt-cpusamples

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

java.hprof.txt-heapsites

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

pom.xml

Post 3.1.0-beta

2011-04-15 22:28:52 +00:00

S

Description

No description provided

heritrixjavawarcwebcrawling

15 MiB

Languages

Java 93.3%

HTML 2.6%

Rich Text Format 1.1%

JavaScript 1%

FreeMarker 0.8%

Other 1%