gojomo 4ef460ac00 Crawl-distribution-related improvements ...

* URIAuthorityBasedQueueAssignmentPolicy.java
    choose numbered subqueue on first-path-segment only, so similar URIs land in same subqueue
* CrawlMapper.java
    add queueKey to diversion lines
* HashCrawlMapper.java
    update license

2009-10-26 09:34:12 +00:00

commons

* ObjectIdentityBdbCache.java

2009-10-23 22:33:36 +00:00

dist

* profile-crawler-beans.cxml

2009-10-23 22:34:41 +00:00

engine

Crawl-distribution-related improvements

2009-10-26 09:34:12 +00:00

modules

Post-beta-build

2009-10-07 11:54:12 +00:00

.classpath

Fix issues revealed in extra tests

2009-10-07 10:24:05 +00:00

.project

Fix for [HER-1524] speculativeFixup in ExtractorJS should maintain URL scheme

2009-05-12 22:09:22 +00:00

pom.xml

Post-beta-build

2009-10-07 11:54:12 +00:00

S

Description

No description provided

heritrixjavawarcwebcrawling

14 MiB

Languages

Java 93.3%

HTML 2.6%

Rich Text Format 1.1%

JavaScript 1%

FreeMarker 0.8%

Other 1%