nlevitt 728951d1ff Fix for HER-1791 - heritrix writes revisit record whether or not previous fetch ...

was archived
* CoreAttributeConstants.java
    new flag A_HISTORY_GOOD_TO_STORE w/ javadoc
* WriterPoolProcessor.java
    shouldWrite() - set A_HISTORY_GOOD_TO_STORE on CrawlURI if we decide to skip writing because of previous fetch with identical digest
* WARCWriterProcessor.java
    write() - set A_HISTORY_GOOD_TO_STORE on CrawlURI on successful write to warc
* PersistProcessor.java
    shouldStore() - change to return true if A_HISTORY_GOOD_TO_STORE is set on the CrawlURI

2011-05-26 16:44:53 +00:00

.settings

commit project-specific eclipse settings

2009-11-11 02:05:30 +00:00

commons

Fix HER-1888 StringIndexOutOfBoundsException in

2011-05-19 23:19:11 +00:00

dist

Post 3.1.0-beta

2011-04-15 22:28:52 +00:00

engine

Different fix for HER-1891 which also fixes HER-1890, two cases of "seed

2011-05-26 16:07:28 +00:00

modules

Fix for HER-1791 - heritrix writes revisit record whether or not previous fetch

2011-05-26 16:44:53 +00:00

.classpath

Followup to r7127 - add jna to eclipse classpath

2011-04-13 00:54:26 +00:00

.project

Fix for [HER-1524] speculativeFixup in ExtractorJS should maintain URL scheme

2009-05-12 22:09:22 +00:00

java.hprof.txt

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

java.hprof.txt-cpusamples

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

java.hprof.txt-heapsites

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

pom.xml

Post 3.1.0-beta

2011-04-15 22:28:52 +00:00

S

Description

No description provided

heritrixjavawarcwebcrawling

15 MiB

Languages

Java 93.3%

HTML 2.6%

Rich Text Format 1.1%

JavaScript 1%

FreeMarker 0.8%

Other 1%