heritrix3

mirror of https://github.com/internetarchive/heritrix3.git synced 2026-08-28 17:36:54 +00:00

T

nlevitt c5de0048d1 "Fix" for HER-1951 ExtractorJS produces many false positives

* UriUtils.java
    isLikelyFalsePositive() - check for unusual characters, likely mimetypes, and a couple of other common traps
* UriUtilsTest.java
    add some tests for this code

2011-09-30 00:48:00 +00:00

.settings

commit project-specific eclipse settings

2009-11-11 02:05:30 +00:00

commons

"Fix" for HER-1951 ExtractorJS produces many false positives

2011-09-30 00:48:00 +00:00

dist

Fix HER-1935 Many calls to File.mkdirs() and other file/dir methods don't check the return value. Also fix bug where pointless empty directories were created in scratch dir.

2011-09-12 20:12:10 +00:00

engine

CrawlController FINISHED doesn't guarantee we're ready for shutdown, so add new boolean and event for that purpose.

2011-09-29 17:22:34 +00:00

modules

Fix for HER-1954 bdb closed at crawl finish instead of teardown -- refactor crawl finish and teardown

2011-09-29 00:39:55 +00:00

.classpath

Various little cleanups including several discovered by Aaron using an automated tool.

2011-09-12 02:12:44 +00:00

.project

Fix for [HER-1524] speculativeFixup in ExtractorJS should maintain URL scheme

2009-05-12 22:09:22 +00:00

java.hprof.txt

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

java.hprof.txt-cpusamples

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

java.hprof.txt-heapsites

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

pom.xml

* **/pom.xml

2011-08-05 17:46:57 +00:00