lee/heritrix3
1
0
Fork 0
mirror of https://github.com/internetarchive/heritrix3.git synced 2026-08-06 14:51:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
186 Commits 40 Branches 31 Tags
047a157fe8e94bff12a8110a857b06bc053ec4d8
Commit Graph
11 Commits
Author SHA1 Message Date
gojomo 047a157fe8 [HER-1605] Refactor parameterizable policies out of frontier 
* selftest-crawler.beans.cxml, FormAuthSelfTest.java, Precedence[134]SelfTest.java
    update self-tests for new chains refactoring
 2009-10-05 23:44:30 +00:00
gojomo 16538f175c Cleanup, refactoring 
* (many)
   update license notice to Apache where appropriate
   eliminate ProcessorURI, DefaultProcessorURI in favor of CrawlURI (now in modules package)
   other comment/warning/unused code cleanup
 2009-10-05 22:49:19 +00:00
gojomo 4d06b239ee Push CrawlURI and related constants down to modules subproject/package 
(many)
 2009-08-06 20:22:00 +00:00
gojomo 4251e5311f * SelfTestBase.java 
report full path of unclosed ARC for manual checking -- truly unclosed or timing issue?
 2009-07-08 01:21:49 +00:00
gojomo 4583ff7306 Rename Rrc2617Credential to HttpAuthenticationCredential 
* (multiple)
    use more-familiar name for HTTP authentication
 2009-07-06 22:09:52 +00:00
gojomo 771d23240c refactor sheets to better enable mid-crawl changes 
* Sheet.java
    make non-abstract; allow for name that might not be beanName
* SheetAssociation.java
    define targets as list of names, rather than Sheets themselves
* SheetForDecideRuled.java -> DecideRuledSheetAssociation.java; SheetForSurtPrefixes.java -> SurtPrefixesSheetAssociation.java
    make association separate from Sheet -- so same Sheet can be associated more than one place, more than one way
* SheetOverlaysManager.java
    match changes to Sheet and SheetAssociations
    offer convenience methods for post-construction addition of Sheets, associations
    use internal name-to-Sheet mapping, allowing for mid-crawl Sheet additions not in bean factory
* Precedence1SelfTest.java, Precedence4SelfTest.java
    update configs for Sheet changes
 2009-06-05 02:12:32 +00:00
gojomo 81a9a9f0f3 Fix unit test 
* BadURIsStopPageParsingSelfTest.java
    update expected URIs to match H2 branch / fixed code
 2009-05-15 00:27:27 +00:00
gojomo 2c11eb1dc2 Remove cruft comments 2009-05-12 19:50:05 +00:00
gojomo 8de6b2a9c5 Fix for [HER-1502] selftests break if 'localhost' does not resolve to 127.0.0.1 
* (all)
    change 'localhost' to '127.0.0.1'
 2009-05-12 18:40:18 +00:00
gojomo c8a5446695 Test robustness 
* SelfTestBase.java
    don't allow negative random passwords, in case leading '-' is causing problems
* Heritrix.java
    echo arguments when showing usage info -- to understand what went wrong
 2009-05-12 02:10:37 +00:00
gojomo e047bf68e0 copy 'springy' branch to heritrix3 2009-05-11 22:56:36 +00:00