gojomo 2bb65e9200 [HER-1546] Springify(5): Update checkpointing to work smoothly with spring-configured crawls ...

processor-related bean checkpoint support:
* Processor.java
    implement Checkpointable and BeanNameAware; methods to support JSON state-saving
* DispositionChain.java
    implement Checkpointable and during-checkpoint disposition-lockout for state stability
* **Extractor**.java
    pull common reporting & checkpointing up to Extractor.java
* WriterPoolProcessor.java
    implement Checkpointable; freeze and roll writer-pool during checkpoint
* PersistLogProcessor.java
    roll log on checkpoint
* TextSeedModule.java, SeedModule.java
    eliminate obsolete (and probably unnecessary) checkpoint support
* (others)
    adapt to above changes

2009-11-19 22:52:39 +00:00

.settings

commit project-specific eclipse settings

2009-11-11 02:05:30 +00:00

commons

[HER-1546] Springify(5): Update checkpointing to work smoothly with spring-configured crawls

2009-11-19 22:45:07 +00:00

dist

* logging.properties: default PersistLoadProcessor log level INFO to see if

2009-11-13 01:50:13 +00:00

engine

[HER-1546] Springify(5): Update checkpointing to work smoothly with spring-configured crawls

2009-11-19 22:45:07 +00:00

modules

[HER-1546] Springify(5): Update checkpointing to work smoothly with spring-configured crawls

2009-11-19 22:52:39 +00:00

.classpath

Update commons-net to 2.0 to incorporate fix to this bug -

2009-11-17 02:49:57 +00:00

.project

Fix for [HER-1524] speculativeFixup in ExtractorJS should maintain URL scheme

2009-05-12 22:09:22 +00:00

pom.xml

Finishing up [HER-1561]

2009-11-11 03:23:09 +00:00

S

Description

No description provided

heritrixjavawarcwebcrawling

14 MiB

Languages

Java 93.3%

HTML 2.6%

Rich Text Format 1.1%

JavaScript 1%

FreeMarker 0.8%

Other 1%