nlevitt 5e1571f8dd HER-1790 - record warc where url was saved in crawl.log ...

* CrawlURI.java
    new field JSONObject extraInfo, methods getExtraInfo() and addExtraInfo()
* WARCWriterProcessor.java
    write() - on success, add warcFilename to CrawlURI extraInfo
* CrawlerLoggerModule.java
    new config option logExtraInfo, default false 
* UriProcessingFormatter.java
    new field logExtraInfo
    format() - include CrawlURI extraInfo if logExtraInfo is enabled
               also include "-" if CrawlURI has no annotations, since this is no longer the last field on the line
* profile-crawler-beans.cxml
    <!-- <property name="logExtraInfo" value="false" /> -->
* NonFatalErrorFormatter.java, RuntimeErrorFormatter.java
    new constructor to handle logExtraInfo since these subclass UriProcessingFormatter

2011-05-25 22:11:18 +00:00

..

.settings

copy 'springy' branch to heritrix3

2009-05-11 22:56:36 +00:00

src

HER-1790 - record warc where url was saved in crawl.log

2011-05-25 22:11:18 +00:00

.classpath

copy 'springy' branch to heritrix3

2009-05-11 22:56:36 +00:00

.project

copy 'springy' branch to heritrix3

2009-05-11 22:56:36 +00:00

pom.xml

Post 3.1.0-beta

2011-04-15 22:28:52 +00:00