mirror of
https://github.com/internetarchive/heritrix3.git
synced 2026-08-22 06:26:32 +00:00
acedca17886ccdb965989adc1444319dd50e79bc
setting "independentExtractors" - when enabled, extractors run regardless of
whether other extractors have run
* profile-crawler-beans.cxml, AbstractFrontier.java, ExtractorParameters.java,
Extractor.java
new setting independentExtractors
* ContentExtractor.java
shouldProcess() - respect independentExtractors
Languages
Java
93.3%
HTML
2.6%
Rich Text Format
1.1%
JavaScript
1%
FreeMarker
0.8%
Other
1%