mirror of
https://github.com/internetarchive/heritrix3.git
synced 2026-10-07 04:41:23 +00:00
acedca17886ccdb965989adc1444319dd50e79bc
setting "independentExtractors" - when enabled, extractors run regardless of
whether other extractors have run
* profile-crawler-beans.cxml, AbstractFrontier.java, ExtractorParameters.java,
Extractor.java
new setting independentExtractors
* ContentExtractor.java
shouldProcess() - respect independentExtractors
Languages
Java
93.5%
HTML
2.5%
Rich Text Format
1%
JavaScript
1%
FreeMarker
0.8%
Other
1%