nlevitt 3cfc315de9 Fix bug reported by Travis where each url in action directory ".include" file is reported as "not canonicalized" in heritrix_out, and some end up crawled in spite of being considered included ...

* WorkQueueFrontier.java
    considerIncluded(CrawlURI) - call FrontierPreparer.prepare(CrawlURI) so that CrawlURI is canonicalized etc before being considered included (similar to what schedule() does)
* CrawlURI.java
    getCanonicalString(), getPolitenessDelay() - use logger instead of System.err

2011-08-02 01:07:11 +00:00

..

src

Fix bug reported by Travis where each url in action directory ".include" file is reported as "not canonicalized" in heritrix_out, and some end up crawled in spite of being considered included

2011-08-02 01:07:11 +00:00

testdata/selftest

fix selftests

2011-07-15 21:34:59 +00:00

.classpath

…

.cvsignore

…

.project

…

pom.xml

Post 3.1.0-RC1

2011-07-26 03:42:02 +00:00