c50f4dc461
Bump org.apache.maven.plugins:maven-resources-plugin from 2.5 to 3.3.1 ( #674 )
2025-10-27 01:17:23 +00:00
8fe22b503c
Bump org.apache.maven.plugins:maven-javadoc-plugin from 2.6.1 to 3.12.0 ( #673 )
2025-10-27 01:16:59 +00:00
3a27aeb37d
Merge pull request #671 from internetarchive/adam/handle_more_bdb_shutdown_interrupts
...
fix: handle more bdb shutdown interrupts
2025-10-27 10:06:20 +09:00
dd11f87ce7
Enable dependabot updates monthly with minor updates grouped
2025-10-27 10:05:16 +09:00
26bb59621b
Merge pull request #672 from internetarchive/adam/add_configurable_extractor_js_script_attribute_rules
...
feat: Add configurable regex rules to block extraction of script tags based on the attributes of the tag.
2025-10-21 22:11:28 +09:00
8d09cc4e50
feat: Pass along script tag attributes to JS extractor for configurable rejection.
2025-10-07 11:04:12 -07:00
558727ac37
fix handle more bdb shutdown interrupts
2025-10-03 17:17:46 -07:00
29d2d7919b
Merge pull request #670 from internetarchive/adam/fix_configurable_js_extractor_strict_overlay
...
fix: sheet setting of extractorJs.strict doesn't work without kp keyname matching
2025-10-01 08:35:50 +00:00
e92475ac43
fix: sheet setting of extractorJs.strict doesn't work without kp keyname matching
2025-09-30 14:14:06 -07:00
978345c51a
Merge pull request #669 from internetarchive/adam/fix_crawl_end_time_checkpoint_resumption
...
fix: don't restore crawlEndTime when resuming from checkpoint.
2025-09-30 07:21:15 +10:00
38e7156ef6
fix: don't restore crawlEndTime when resuming from checkpoint.
2025-09-25 10:50:47 -07:00
b988940eff
[maven-release-plugin] prepare for next development iteration
2025-09-22 13:57:47 +09:00
e3bdd7220e
[maven-release-plugin] prepare release 3.11.0
2025-09-22 13:57:41 +09:00
41aa946adb
Update CHANGELOG for 3.11.0 release
2025-09-22 13:56:26 +09:00
25b621ce61
Bump jakarta.xml.bind-api from 4.0.2 to 4.0.4
2025-09-22 13:51:48 +09:00
cb986a0ed2
Bump codemirror__language from 6.11.2 to 6.11.3
2025-09-22 13:50:01 +09:00
e439f3568b
Bump jetty from 12.0.25 to 12.0.27
2025-09-22 13:48:49 +09:00
1ed64142ea
Bump jsch from 2.27.2 to 2.27.3
2025-09-22 13:46:42 +09:00
94c0daeec5
Bump spring from 6.2.10 to 6.2.11
2025-09-22 13:45:11 +09:00
95d74ab4e7
Bump gson from 2.13.1 to 2.13.2
2025-09-22 13:43:40 +09:00
5e2809f7c6
Merge pull request #668 from internetarchive/adam/knowledgable_extractorjs_extends_configurable_extractorjs
...
feat: KnowledgableExtractorJS extends ConfigurableExtractorJS to inhe…
2025-09-22 13:39:21 +09:00
ec3cbe679f
feat: KnowledgableExtractorJS extends ConfigurableExtractorJS to inherit new config options
2025-09-18 15:13:01 -07:00
351cc2bea2
Update CHANGELOG.md for #667
2025-09-12 16:45:51 +09:00
96b6480f9c
Merge pull request #667 from internetarchive/adam/strip_invalid_xml_chars_from_rest_api_output
...
feat: strip invalid chars from xml rest api output
2025-09-12 16:38:55 +09:00
fd2aed89fb
feat: strip invalid chars from xml rest api output
2025-09-11 17:42:07 -07:00
d484007f57
FetchHTTP2: Note that WARC doesn't specify the recording of HTTP/2 and 3
...
iipc/warc-specifications#106
2025-09-06 10:29:24 +09:00
20dcc89244
[maven-release-plugin] prepare for next development iteration
2025-08-29 17:26:11 +09:00
7a2c676dc9
[maven-release-plugin] prepare release 3.10.2
2025-08-29 17:26:05 +09:00
de47ab97a6
Update CHANGELOG for 3.10.2
2025-08-29 17:21:13 +09:00
31539e2d62
Use Groovy BOM to ensure consistent versions
2025-08-28 15:35:14 +09:00
e42306ceb1
Use slf4j BOM to ensure consistent versions
2025-08-28 15:32:48 +09:00
bb04d1e0a9
Bump jetty from 12.0.22 to 12.0.25
2025-08-28 15:27:42 +09:00
3cde816e95
Use jetty BOM to ensure consistent versions
2025-08-28 15:27:10 +09:00
c79de0bec5
Merge pull request #665 from internetarchive/fetchdns-zero-addr
...
FetchDNS: Treat 0.0.0.0 as resolution failure
2025-08-26 09:58:44 +09:00
219139e4e9
FetchDNS: Treat 0.0.0.0 as resolution failure
...
If there are multiple addresses then ignore 0.0.0.0. If the only address is 0.0.0.0 treat it as a DNS resolution failure. This should prevent us from throwing IllegalStateException later in DefaultServerCache.getHostFor().
Fixes #428
2025-08-21 09:47:48 +09:00
3c6191fd5a
Merge pull request #664 from internetarchive/deps
...
Upgrade dependencies for 3.10.2 release
2025-08-20 17:18:17 +09:00
adaf44caf2
Add dependency upgrades to CHANGELOG
2025-08-20 17:11:42 +09:00
30707296f6
Bump amqp-client from 5.25.0 to 5.26.0
2025-08-20 17:08:15 +09:00
148477b4d3
Bump commons-net from 3.11.1 to 3.12.0
2025-08-20 17:06:31 +09:00
cbd72abfb7
Bump commons-codec from 1.18.0 to 1.19.0
2025-08-20 17:06:12 +09:00
ab1c9bef5a
Bump commons-cli from 1.9.0 to 1.10.0
2025-08-20 17:05:52 +09:00
8a481f719f
Bump groovy from 4.0.27 to 4.0.28
2025-08-20 17:05:28 +09:00
b1be6fbe0d
Bump codemirror__view from 6.37.2 to 6.38.1
2025-08-20 17:05:03 +09:00
362a40f3db
Bump spring from 6.2.9 to 6.2.10
2025-08-20 17:04:20 +09:00
7f1e734373
Bump junit-jupiter from 5.13.3 to 5.13.4
2025-08-20 17:04:07 +09:00
e06ccbe70c
versions-maven-plugin: ignore pre-release dependency versions
2025-08-20 17:00:17 +09:00
5983f61626
Bump codemirror@legacy-modes from 6.5.0 to 6.5.1
2025-08-20 16:53:23 +09:00
c8c2512e77
Bump codemirror@language from 6.11.1 to 6.11.2
2025-08-20 16:53:10 +09:00
194046d35b
Merge pull request #663 from mistydemeo/misty/ampq_provide_user_agent
...
AMQPPublishProcessor: pass along user agent
2025-08-14 07:10:47 +09:00
e8e3ad6ab5
AMQPPublishProcessor: pass along user agent
...
We pass along other metadata, but so far we don't pass along the
user agent. We'd like to start letting Umbra make use of it in
its own requests.
2025-08-13 14:48:31 -07:00
dependabot[bot]