gojomo e1bbbf5a59 [HER-1704] WorkQueueFrontier.snoozedClassQueues not bounded in size, not reported in useful order ...

* WorkQueueFrontier.java
    add snoozedOverflow map of (wakeTime)->(DelayedWorkQueue) for snoozes over a capped size
    maintain in parallel to snoozedClassQueues DelayQueue, maintain atomic size count
    in standard report, presort snoozedClassQueues before displaying
* DelayedWorkQueue.java
    move to top-level so serialization doesn't pull out whole frontier
* BdbFrontier.java
    initialize snoozedOverflow
* BdbMultipleWorkQueues.java
    improve error message seen on problematic checkpoint-recovery

2009-12-03 19:37:27 +00:00

.settings

commit project-specific eclipse settings

2009-11-11 02:05:30 +00:00

commons

Improve Maven build robustness

2009-12-02 01:34:40 +00:00

dist

Improve Maven build robustness

2009-12-02 01:34:40 +00:00

engine

[HER-1704] WorkQueueFrontier.snoozedClassQueues not bounded in size, not reported in useful order

2009-12-03 19:37:27 +00:00

modules

[HER-1718] misleading "writer subdirectory" shown in webui

2009-12-03 08:41:08 +00:00

.classpath

Make Maven build more robust

2009-12-03 19:02:13 +00:00

.project

Fix for [HER-1524] speculativeFixup in ExtractorJS should maintain URL scheme

2009-05-12 22:09:22 +00:00

pom.xml

Improve Maven build robustness

2009-12-02 01:34:40 +00:00

S

Description

No description provided

heritrixjavawarcwebcrawling

15 MiB

Languages

Java 93.3%

HTML 2.6%

Rich Text Format 1%

JavaScript 1%

FreeMarker 0.8%

Other 1.1%