heritrix3

mirror of https://github.com/internetarchive/heritrix3.git synced 2026-09-16 10:45:47 +00:00

T

gojomo bc698c09fc [HER-1480] URIs logged (as -6 or -7) that should never be scheduled

* LaxURI.java
    increase tolerance with regard to path-segments
* UURIFactory.java
    allow digits in scheme regex
    discard old supported-schemes code
* UURIFactoryTest.java
    tests for roundtrip serialization of problematic hostlike-scheme and bars-in-path
* CrawlerLoggerModule.java
    discard special-casing of URI scheme errors
* SchemeNotInSetDecideRule.java
    rule to apply to URIs of unknown schemes; by default REJECTs those not usually handled by Heritrix
* **/profile-crawler-beans.cxml
    add REJECT SchemeNotInSetDecideRule

2010-09-03 00:24:13 +00:00

.settings

commit project-specific eclipse settings

2009-11-11 02:05:30 +00:00

commons

[HER-1480] URIs logged (as -6 or -7) that should never be scheduled

2010-09-03 00:24:13 +00:00

dist

[HER-1480] URIs logged (as -6 or -7) that should never be scheduled

2010-09-03 00:24:13 +00:00

engine

[HER-1480] URIs logged (as -6 or -7) that should never be scheduled