gojomo 50ee78f6d2 [HER-1546] Springify(5): Update checkpointing to work smoothly with spring-configured crawls ...

* BdbFrontier.java
    implement Checkpointable; save state via JSON or BDB; restore queues-of-queues on recovery
* WorkQueueFrontier.java
    (deactivateQueue) (retireQueue) protected
* BdbUriUniqFilter.java
    implement Checkpointable; save state via JSON or BDB; restore
* WorkQueue.java
    make peekItem transient -- should not be held through checkpoint
    make retired protected
* Frontier.java, AbstractFrontier.java
    remove/update obsolete code

2009-11-20 00:59:00 +00:00

.settings

commit project-specific eclipse settings

2009-11-11 02:05:30 +00:00

commons

* DefaultWriterPoolSettings.java

2009-11-20 00:50:17 +00:00

dist

* logging.properties: default PersistLoadProcessor log level INFO to see if

2009-11-13 01:50:13 +00:00

engine

[HER-1546] Springify(5): Update checkpointing to work smoothly with spring-configured crawls

2009-11-20 00:59:00 +00:00

modules

[HER-1546] Springify(5): Update checkpointing to work smoothly with spring-configured crawls

2009-11-20 00:47:54 +00:00

.classpath

Update commons-net to 2.0 to incorporate fix to this bug -

2009-11-17 02:49:57 +00:00

.project

Fix for [HER-1524] speculativeFixup in ExtractorJS should maintain URL scheme

2009-05-12 22:09:22 +00:00

pom.xml

Finishing up [HER-1561]

2009-11-11 03:23:09 +00:00

S

Description

No description provided

heritrixjavawarcwebcrawling

14 MiB

Languages

Java 93.3%

HTML 2.6%

Rich Text Format 1.1%

JavaScript 1%

FreeMarker 0.8%

Other 1%