gojomo d654bb5651 [HER-1660] allow adding seeds, recovery-journal-like URI data at any point in crawl via 'action directory' ...

* ActionDirectory.java
     support for .seeds, .recover, .include, .schedule, .force files
* CrawlController.java
    change default for pause-at-start to true; ensure enters PAUSED rather than PAUSING
* Frontier.java 
    (importRecoverFormat) support method for .recover, .include, .schedule, .force additions
    (considerIncluded) change to accept CrawlURI
* AbstractFrontier.java
    (importRecoverFormat) support method for .recover, .include, .schedule, .force additions
* BdbFrontier.java
    remove too-strict assertion
* FrontierJournal.java
    rename recover-log 'frontier.recover.gz' (so that '.recover' is a dot-suffix)
* WorkQueueFrontier.java
    (considerIncluded) change to accept CrawlURI

2009-08-12 01:50:51 +00:00

commons

Move getBufferedReader() -> IoUtils

2009-08-11 02:17:20 +00:00

dist

[HER-1642] fix HOWTO-launch document

2009-07-13 23:06:23 +00:00

engine

[HER-1660] allow adding seeds, recovery-journal-like URI data at any point in crawl via 'action directory'

2009-08-12 01:50:51 +00:00

modules

Move getBufferedReader() -> IoUtils

2009-08-11 02:17:20 +00:00

.classpath

[HER-1505] Expand BeanshellProcessor/BeanshellDecideRule for every JVM-friendly scripting language (Javascript/Jython/Groovy/JRuby)

2009-06-05 01:03:10 +00:00

.project

Fix for [HER-1524] speculativeFixup in ExtractorJS should maintain URL scheme

2009-05-12 22:09:22 +00:00

pom.xml

* **/pom.xml

2009-06-11 09:09:43 +00:00

S

Description

No description provided

heritrixjavawarcwebcrawling

15 MiB

Languages

Java 93.3%

HTML 2.6%

Rich Text Format 1.1%

JavaScript 1%

FreeMarker 0.8%

Other 1%