Commit Graph
2837 Commits
Author SHA1 Message Date
Alex Osborne 291164a09e dependabot: add ignore for com.sleepycat:je
It has a larger version number in central that's actually older.
2025-10-27 15:14:35 +09:00
Alex Osborne d69dc04528 dependabot: add ignores for codemirror and jetty 12.1 2025-10-27 14:44:46 +09:00
Alex Osborne a50c012d2d Merge pull request #677 from internetarchive/dependabot/maven/org.apache.groovy-groovy-bom-5.0.2
Bump org.apache.groovy:groovy-bom from 4.0.28 to 5.0.2
2025-10-27 10:21:22 +09:00
Alex Osborne bfe45b25cd Merge pull request #675 from internetarchive/dependabot/maven/org.apache.maven.plugins-maven-surefire-plugin-3.5.4
Bump org.apache.maven.plugins:maven-surefire-plugin from 2.22.2 to 3.5.4
2025-10-27 10:20:26 +09:00
dependabot[bot] c50f4dc461 Bump org.apache.maven.plugins:maven-resources-plugin from 2.5 to 3.3.1 (#674) 2025-10-27 01:17:23 +00:00
dependabot[bot] 8fe22b503c Bump org.apache.maven.plugins:maven-javadoc-plugin from 2.6.1 to 3.12.0 (#673) 2025-10-27 01:16:59 +00:00
dependabot[bot] 6c25801d13 Bump org.apache.groovy:groovy-bom from 4.0.28 to 5.0.2
Bumps [org.apache.groovy:groovy-bom](https://github.com/apache/groovy) from 4.0.28 to 5.0.2.
- [Commits](https://github.com/apache/groovy/commits)

---
updated-dependencies:
- dependency-name: org.apache.groovy:groovy-bom
  dependency-version: 5.0.2
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-10-27 01:15:06 +00:00
dependabot[bot] 237d19a5d4 Bump org.apache.maven.plugins:maven-surefire-plugin from 2.22.2 to 3.5.4
Bumps [org.apache.maven.plugins:maven-surefire-plugin](https://github.com/apache/maven-surefire) from 2.22.2 to 3.5.4.
- [Release notes](https://github.com/apache/maven-surefire/releases)
- [Commits](https://github.com/apache/maven-surefire/compare/surefire-2.22.2...surefire-3.5.4)

---
updated-dependencies:
- dependency-name: org.apache.maven.plugins:maven-surefire-plugin
  dependency-version: 3.5.4
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-10-27 01:14:45 +00:00
Alex Osborne 3a27aeb37d Merge pull request #671 from internetarchive/adam/handle_more_bdb_shutdown_interrupts
fix: handle more bdb shutdown interrupts
2025-10-27 10:06:20 +09:00
Alex Osborne dd11f87ce7 Enable dependabot updates monthly with minor updates grouped 2025-10-27 10:05:16 +09:00
Alex Osborne 26bb59621b Merge pull request #672 from internetarchive/adam/add_configurable_extractor_js_script_attribute_rules
feat: Add configurable regex rules to block extraction of script tags based on the attributes of the tag.
2025-10-21 22:11:28 +09:00
Adam Miller 8d09cc4e50 feat: Pass along script tag attributes to JS extractor for configurable rejection. 2025-10-07 11:04:12 -07:00
Adam Miller 558727ac37 fix handle more bdb shutdown interrupts 2025-10-03 17:17:46 -07:00
Kristinn Sigurðsson 29d2d7919b Merge pull request #670 from internetarchive/adam/fix_configurable_js_extractor_strict_overlay
fix: sheet setting of extractorJs.strict doesn't work without kp keyname matching
2025-10-01 08:35:50 +00:00
Adam Miller e92475ac43 fix: sheet setting of extractorJs.strict doesn't work without kp keyname matching 2025-09-30 14:14:06 -07:00
Alex Osborne 978345c51a Merge pull request #669 from internetarchive/adam/fix_crawl_end_time_checkpoint_resumption
fix: don't restore crawlEndTime when resuming from checkpoint.
2025-09-30 07:21:15 +10:00
Adam Miller 38e7156ef6 fix: don't restore crawlEndTime when resuming from checkpoint. 2025-09-25 10:50:47 -07:00
Alex Osborne b988940eff [maven-release-plugin] prepare for next development iteration 2025-09-22 13:57:47 +09:00
Alex Osborne e3bdd7220e [maven-release-plugin] prepare release 3.11.0 3.11.0 2025-09-22 13:57:41 +09:00
Alex Osborne 41aa946adb Update CHANGELOG for 3.11.0 release 2025-09-22 13:56:26 +09:00
Alex Osborne 25b621ce61 Bump jakarta.xml.bind-api from 4.0.2 to 4.0.4 2025-09-22 13:51:48 +09:00
Alex Osborne cb986a0ed2 Bump codemirror__language from 6.11.2 to 6.11.3 2025-09-22 13:50:01 +09:00
Alex Osborne e439f3568b Bump jetty from 12.0.25 to 12.0.27 2025-09-22 13:48:49 +09:00
Alex Osborne 1ed64142ea Bump jsch from 2.27.2 to 2.27.3 2025-09-22 13:46:42 +09:00
Alex Osborne 94c0daeec5 Bump spring from 6.2.10 to 6.2.11 2025-09-22 13:45:11 +09:00
Alex Osborne 95d74ab4e7 Bump gson from 2.13.1 to 2.13.2 2025-09-22 13:43:40 +09:00
Alex Osborne 5e2809f7c6 Merge pull request #668 from internetarchive/adam/knowledgable_extractorjs_extends_configurable_extractorjs
feat: KnowledgableExtractorJS extends ConfigurableExtractorJS to inhe…
2025-09-22 13:39:21 +09:00
Adam Miller ec3cbe679f feat: KnowledgableExtractorJS extends ConfigurableExtractorJS to inherit new config options 2025-09-18 15:13:01 -07:00
Alex Osborne 351cc2bea2 Update CHANGELOG.md for #667 2025-09-12 16:45:51 +09:00
Alex Osborne 96b6480f9c Merge pull request #667 from internetarchive/adam/strip_invalid_xml_chars_from_rest_api_output
feat: strip invalid chars from xml rest api output
2025-09-12 16:38:55 +09:00
Adam Miller fd2aed89fb feat: strip invalid chars from xml rest api output 2025-09-11 17:42:07 -07:00
Alex Osborne d484007f57 FetchHTTP2: Note that WARC doesn't specify the recording of HTTP/2 and 3
iipc/warc-specifications#106
2025-09-06 10:29:24 +09:00
Alex Osborne 20dcc89244 [maven-release-plugin] prepare for next development iteration 2025-08-29 17:26:11 +09:00
Alex Osborne 7a2c676dc9 [maven-release-plugin] prepare release 3.10.2 3.10.2 2025-08-29 17:26:05 +09:00
Alex Osborne de47ab97a6 Update CHANGELOG for 3.10.2 2025-08-29 17:21:13 +09:00
Alex Osborne 31539e2d62 Use Groovy BOM to ensure consistent versions 2025-08-28 15:35:14 +09:00
Alex Osborne e42306ceb1 Use slf4j BOM to ensure consistent versions 2025-08-28 15:32:48 +09:00
Alex Osborne bb04d1e0a9 Bump jetty from 12.0.22 to 12.0.25 2025-08-28 15:27:42 +09:00
Alex Osborne 3cde816e95 Use jetty BOM to ensure consistent versions 2025-08-28 15:27:10 +09:00
Alex Osborne c79de0bec5 Merge pull request #665 from internetarchive/fetchdns-zero-addr
FetchDNS: Treat 0.0.0.0 as resolution failure
2025-08-26 09:58:44 +09:00
Alex Osborne 219139e4e9 FetchDNS: Treat 0.0.0.0 as resolution failure
If there are multiple addresses then ignore 0.0.0.0. If the only address is 0.0.0.0 treat it as a DNS resolution failure. This should prevent us from throwing IllegalStateException later in DefaultServerCache.getHostFor().

Fixes #428
2025-08-21 09:47:48 +09:00
Alex Osborne 3c6191fd5a Merge pull request #664 from internetarchive/deps
Upgrade dependencies for 3.10.2 release
2025-08-20 17:18:17 +09:00
Alex Osborne adaf44caf2 Add dependency upgrades to CHANGELOG 2025-08-20 17:11:42 +09:00
Alex Osborne 30707296f6 Bump amqp-client from 5.25.0 to 5.26.0 2025-08-20 17:08:15 +09:00
Alex Osborne 148477b4d3 Bump commons-net from 3.11.1 to 3.12.0 2025-08-20 17:06:31 +09:00
Alex Osborne cbd72abfb7 Bump commons-codec from 1.18.0 to 1.19.0 2025-08-20 17:06:12 +09:00
Alex Osborne ab1c9bef5a Bump commons-cli from 1.9.0 to 1.10.0 2025-08-20 17:05:52 +09:00
Alex Osborne 8a481f719f Bump groovy from 4.0.27 to 4.0.28 2025-08-20 17:05:28 +09:00
Alex Osborne b1be6fbe0d Bump codemirror__view from 6.37.2 to 6.38.1 2025-08-20 17:05:03 +09:00
Alex Osborne 362a40f3db Bump spring from 6.2.9 to 6.2.10 2025-08-20 17:04:20 +09:00