Commit Graph
3112 Commits
Author SHA1 Message Date
Alex Osborne 486dffbedf BrowserProcessor: allow per-browser concurrency, executable and options 2026-11-13 10:12:38 +09:00
Alex Osborne d7c9a5581e BrowserProcessor: launch browsers on other machines over ssh 2026-11-13 10:12:38 +09:00
Alex Osborne c93c928a54 SshBrowserProcess: launch a browser on another machine over ssh 2026-11-13 10:12:38 +09:00
Alex Osborne d0e5921aa6 LocalWebDriverBiDi: move launching the browser process into BrowserProcess 2026-11-12 17:04:28 +09:00
Alex Osborne dc070b4af1 BrowserProcessor: close idle browsers and relaunch them when a page needs one
Many small jobs in one JVM would otherwise each hold browsers open for as long as the job runs or sits paused.
2026-11-12 15:47:09 +09:00
Alex Osborne 51668638b0 BrowserProcessor: track each browser's state with an enum instead of a flag 2026-11-12 15:29:43 +09:00
Alex Osborne 0f8644fd65 LocalWebDriverBiDi: make the command timeout configurable 2026-11-12 13:50:20 +09:00
Alex Osborne 9cefc32df0 LocalWebDriverBiDi: kill the browser if it stops answering 2026-11-12 13:50:20 +09:00
Alex Osborne d7f82bce4d BrowserProcessor: launch browsers in parallel and retry failed launches with backoff 2026-11-12 13:44:03 +09:00
Alex Osborne ad8e3fb51b BrowserProcessor: support several browsers 2026-11-12 13:44:03 +09:00
Alex Osborne 7369ec2980 BrowserProcessor: move per-browser state into a nested Browser class 2026-11-12 13:43:55 +09:00
Alex Osborne 7ca3574b1b WebDriverBiDi: move isAlive() onto the interface 2026-11-12 13:43:55 +09:00
Alex Osborne c743cc0a78 Merge pull request #818 from internetarchive/browser-tests-ci
CI: Run browser tests separately against Firefox and Chrome
2026-11-12 13:43:24 +09:00
Alex Osborne 7553c9c183 LocalWebDriverBiDi: kill ChromeDriver's browser too if the launch fails 2026-11-12 13:33:35 +09:00
Alex Osborne a45252de22 LocalWebDriverBiDi: allow the launch timeout for creating the session 2026-11-12 13:33:30 +09:00
Alex Osborne e1eee1e25f CI: build docgen for the browser tests 2026-11-12 13:28:42 +09:00
Alex Osborne ec320998c2 CI: run the browser tests in their own job against Firefox and Chrome 2026-11-12 13:19:14 +09:00
Alex Osborne 8acdba74c5 LocalWebDriverBiDi: wait for ChromeDriver's browser to exit on close 2026-11-12 13:19:14 +09:00
Alex Osborne 5af5ceace1 Merge pull request #816 from internetarchive/browser-proxy-hardening
BrowserProcessor: prevent recording proxy from acting as an open proxy
2026-11-12 09:28:00 +09:00
Alex Osborne 74d236ee57 BrowserProcessor: reject proxy requests that don't belong to an open page 2026-11-11 22:21:44 +09:00
Alex Osborne 21b808f9c2 MitmProxy: listen on loopback only 2026-11-11 22:02:19 +09:00
Alex Osborne dec91bca04 Merge pull request #803 from RaphaelFakhri/fix-alt-svc-default-max-age
FetchHTTP2: Default Alt-Svc max age to 24 hours
2026-11-07 09:04:07 +09:00
Raphael Fakhri 1a120ea3c2 FetchHTTP2Test: Check the Alt-Svc expiry instead of sleeping 2026-11-06 20:36:21 +00:00
Alex Osborne 0d1eae1082 Add missing processors to bean reference (#815) 2026-11-06 14:41:51 +09:00
Alex Osborne c09f281c0f Merge pull request #812 from internetarchive/svg-extractor
Add ExtractorSVG for links in SVG images
2026-11-06 13:56:57 +09:00
Alex Osborne 832279989d Add ExtractorSVG to the Groovy default profile 2026-11-06 13:56:11 +09:00
Alex Osborne 5838dbf1f9 ExtractorSVG: obey ExtractorHTML obeyRelNofollow setting 2026-11-05 16:17:28 +09:00
Alex Osborne 9d79ef7372 Add ExtractorSVG and extract links from inline SVG
ExtractorSVG parses SVG with the JDK's StAX parser and extracts hrefs
from elements like <image>, <use> and <script> as embeds and from <a>
as links, along with <?xml-stylesheet?>, url() in presentation
attributes, <style>, <script>, animated hrefs and HTML in
<foreignObject>. Like browsers it requires the SVG namespace, decides
by the root element whether text/xml and application/xml responses
are SVG, and keeps the links found before any XML error. It's added
to the default profile before extractorHtml.

ExtractorHTML and JerichoExtractorHTML now treat hrefs on those inline
SVG elements as embeds rather than links, and extract url() from
presentation attributes like fill. ExtractorCSS now ignores
same-document references like url(#gradient).

Fixes #796
2026-11-05 16:17:28 +09:00
Alex Osborne a35dcb86a6 Merge pull request #811 from internetarchive/crawluri-has-content-type
Add CrawlURI.hasContentType() for media type checks
2026-11-05 16:17:25 +09:00
Alex Osborne db8b626247 Add .editorconfig 2026-11-05 11:21:32 +09:00
Alex Osborne 7a9e2689b4 Use CrawlURI.hasContentType() for exact media type checks
Replaces startsWith() prefix checks, which also matched longer subtypes,
e.g. "application/vnd.wap.wml" matched the binary
"application/vnd.wap.wmlc". The truncated "application/xhtml" and
"application/vnd.wap.xhtml" checks now name the full "+xml" types. Also
fixes case-sensitive comparisons in ExtractorPDF and ExtractorPDFContent,
and drops BotBlockDetector's private equivalent.

Substring heuristics like ExtractorJS's indexOf("javascript") and
ExtractorXML's indexOf("xml") are intentionally left as they are.
2026-11-05 09:58:58 +09:00
Alex Osborne 5b1f492cc2 CrawlURI: add hasContentType() for media type comparison
Compares the content type's type/subtype with the given media type,
ignoring case and any parameters, so "Text/HTML; charset=utf-8" matches
"text/html" but "text/htmlfoo" doesn't. This replaces ad hoc checks like
toLowerCase().startsWith(...), which also match longer subtypes.
2026-11-05 09:53:25 +09:00
Alex Osborne a6f69a4473 Merge pull request #808 from internetarchive/extractorjs-es-module-imports
ExtractorJS: resolve ES module imports relative to script's URL
2026-11-04 16:41:13 +09:00
Alex Osborne 8cc8a7493b Merge pull request #804 from internetarchive/html-extraction-gaps
ExtractorHTML: extract poster, imagesrcset, formaction and iframe srcdoc
2026-11-04 16:38:38 +09:00
Alex Osborne b8c22606b6 ExtractorHTML: extract links from iframe srcdoc 2026-11-04 15:16:19 +09:00
Alex Osborne 889a6b0082 JerichoExtractorHTML: parse sequentially to ignore tags inside attribute values 2026-11-04 15:10:48 +09:00
Alex Osborne 65621b48d4 ExtractorHTML: don't end tags at '>' inside quoted attribute values
Previously a '>' inside a quoted attribute value, e.g.
onclick="if (a > b) ..." or an iframe srcdoc, ended the tag early and
any attributes after it were lost. Quotes are now only treated as value
delimiters directly after '=', as in browsers.
2026-11-04 15:08:46 +09:00
Alex Osborne 91d41c2084 ExtractorHTML: extract formaction attribute
Only extracted when formmethod=get or extractOnlyFormGets is disabled,
since without formmethod the form's own method applies and would
require tracking state between tags.
2026-11-04 14:54:34 +09:00
Alex Osborne a356bc477d ExtractorHTML: extract link imagesrcset attribute as embed 2026-11-04 14:43:12 +09:00
Alex Osborne a76e5221cc ExtractorHTML: extract poster attribute as embed 2026-11-04 14:40:36 +09:00
Raphael Fakhri 4cfc68cda3 FetchHTTP2: Default Alt-Svc max age to 24 hours
An Alt-Svc header without an ma parameter set the HTTP/3 expiry to
the current time, so the alternative was discarded straight away and
HTTP/3 was never used for that server. RFC 7838 defines the default
freshness lifetime as 24 hours, which the code comment already
states.
2026-11-03 13:54:10 +00:00
Alex Osborne 0f46340d26 Merge pull request #792 from mvanhorn/fix/455-midfetch-abort-statistics
fix: disregard HTTP responses rejected before body fetching
2026-11-02 23:38:13 +09:00
Matt Van Horn a769651bf5 fix: give midfetch aborts their own fetch status code
Add S_MIDFETCH_ABORTED (-5005) and set it in FetchHTTP when
shouldFetchBodyRule rejects a response, in place of S_OUT_OF_SCOPE.
The code means something distinct from a scope rejection, so crawl logs
and reports can now tell the two apart. AbstractFrontier.isDisregarded()
treats it as disregarded, CrawlURI gives it a readable string and the
glossary lists it.
2026-11-02 06:01:06 -08:00
Matt Van Horn 1c27e2e7b0 fix: disregard HTTP responses rejected before body fetching
A rejection by shouldFetchBodyRule now sets S_OUT_OF_SCOPE, causing the
frontier to disregard the URI without charging the queue budget or
retrying it, and skipping extraction and WARC writing. Tests cover
rejected responses and preserve successful handling for accepted or
disabled rules, prerequisites, size limits, and timeouts.

Fixes #455
2026-11-02 00:32:19 -08:00
dependabot[bot] 2dfc290224 Bump actions/setup-java from 6.0.1 to 6.1.0 (#790)
Bumps [actions/setup-java](https://github.com/actions/setup-java) from 6.0.1 to 6.1.0.
- [Release notes](https://github.com/actions/setup-java/releases)
- [Commits](https://github.com/actions/setup-java/compare/v6.0.1...v6.1.0)

---
updated-dependencies:
- dependency-name: actions/setup-java
  dependency-version: 6.1.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-11-02 16:53:05 +09:00
dependabot[bot] ce13a99f71 Bump the minor-and-patch group with 23 updates (#791)
Bumps the minor-and-patch group with 23 updates:

| Package | From | To |
| --- | --- | --- |
| [com.fasterxml.jackson:jackson-bom](https://github.com/FasterXML/jackson-bom) | `2.22.3` | `2.22.4` |
| [org.eclipse.jetty:jetty-bom](https://github.com/jetty/jetty.project) | `12.0.39` | `12.0.40` |
| [org.eclipse.jetty.ee10:jetty-ee10-bom](https://github.com/jetty/jetty.project) | `12.0.39` | `12.0.40` |
| [org.apache.maven.plugins:maven-surefire-plugin](https://github.com/apache/maven-surefire) | `3.6.0` | `3.6.1` |
| [org.codehaus.mojo:versions-maven-plugin](https://github.com/mojohaus/versions) | `2.22.0` | `2.23.0` |
| [org.sonatype.central:central-publishing-maven-plugin](https://github.com/sonatype-nexus-community/central-publishing-maven-plugin) | `0.11.0` | `0.12.0` |
| [commons-codec:commons-codec](https://github.com/apache/commons-codec) | `1.22.1` | `1.23.0` |
| [dnsjava:dnsjava](https://github.com/dnsjava/dnsjava) | `3.6.5` | `3.7.0` |
| [org.springframework:spring-core](https://github.com/spring-projects/spring-framework) | `7.0.9` | `7.0.10` |
| [org.springframework:spring-beans](https://github.com/spring-projects/spring-framework) | `7.0.9` | `7.0.10` |
| [org.springframework:spring-context](https://github.com/spring-projects/spring-framework) | `7.0.9` | `7.0.10` |
| [org.springframework:spring-expression](https://github.com/spring-projects/spring-framework) | `7.0.9` | `7.0.10` |
| [com.esotericsoftware:kryo](https://github.com/EsotericSoftware/kryo) | `5.6.2` | `5.7.1` |
| [com.github.mwiede:jsch](https://github.com/mwiede/jsch) | `2.28.7` | `2.28.8` |
| [org.apache.mina:mina-core](https://github.com/apache/mina) | `2.2.9` | `2.2.10` |
| [org.restlet:org.restlet](https://github.com/restlet/restlet-framework-java) | `2.6.0` | `2.6.1` |
| org.restlet:org.restlet.ext.jetty | `2.6.0` | `2.6.1` |
| [org.restlet:org.restlet.ext.xml](https://github.com/restlet/restlet-framework-java) | `2.6.0` | `2.6.1` |
| [org.restlet:org.restlet.ext.json](https://github.com/restlet/restlet-framework-java) | `2.6.0` | `2.6.1` |
| [org.restlet:org.restlet.ext.crypto](https://github.com/restlet/restlet-framework-java) | `2.6.0` | `2.6.1` |
| org.apache.kafka:kafka-clients | `4.3.1` | `4.4.0` |
| [at.yawk.lz4:lz4-java](https://github.com/yawkat/lz4-java) | `1.12.0` | `1.12.1` |
| [com.google.code.gson:gson](https://github.com/google/gson) | `2.14.0` | `2.15.0` |


Updates `com.fasterxml.jackson:jackson-bom` from 2.22.3 to 2.22.4
- [Commits](https://github.com/FasterXML/jackson-bom/compare/jackson-bom-2.22.3...jackson-bom-2.22.4)

Updates `org.eclipse.jetty:jetty-bom` from 12.0.39 to 12.0.40
- [Release notes](https://github.com/jetty/jetty.project/releases)
- [Commits](https://github.com/jetty/jetty.project/compare/jetty-12.0.39...jetty-12.0.40)

Updates `org.eclipse.jetty.ee10:jetty-ee10-bom` from 12.0.39 to 12.0.40
- [Release notes](https://github.com/jetty/jetty.project/releases)
- [Commits](https://github.com/jetty/jetty.project/compare/jetty-12.0.39...jetty-12.0.40)

Updates `org.eclipse.jetty.ee10:jetty-ee10-bom` from 12.0.39 to 12.0.40
- [Release notes](https://github.com/jetty/jetty.project/releases)
- [Commits](https://github.com/jetty/jetty.project/compare/jetty-12.0.39...jetty-12.0.40)

Updates `org.apache.maven.plugins:maven-surefire-plugin` from 3.6.0 to 3.6.1
- [Release notes](https://github.com/apache/maven-surefire/releases)
- [Commits](https://github.com/apache/maven-surefire/compare/surefire-3.6.0...surefire-3.6.1)

Updates `org.codehaus.mojo:versions-maven-plugin` from 2.22.0 to 2.23.0
- [Release notes](https://github.com/mojohaus/versions/releases)
- [Changelog](https://github.com/mojohaus/versions/blob/master/ReleaseNotes.md)
- [Commits](https://github.com/mojohaus/versions/compare/2.22.0...2.23.0)

Updates `org.sonatype.central:central-publishing-maven-plugin` from 0.11.0 to 0.12.0
- [Release notes](https://github.com/sonatype-nexus-community/central-publishing-maven-plugin/releases)
- [Commits](https://github.com/sonatype-nexus-community/central-publishing-maven-plugin/commits/release-0.12.0)

Updates `commons-codec:commons-codec` from 1.22.1 to 1.23.0
- [Changelog](https://github.com/apache/commons-codec/blob/master/RELEASE-NOTES.txt)
- [Commits](https://github.com/apache/commons-codec/compare/rel/commons-codec-1.22.1...rel/commons-codec-1.23.0)

Updates `dnsjava:dnsjava` from 3.6.5 to 3.7.0
- [Release notes](https://github.com/dnsjava/dnsjava/releases)
- [Changelog](https://github.com/dnsjava/dnsjava/blob/master/Changelog)
- [Commits](https://github.com/dnsjava/dnsjava/commits/v3.7.0)

Updates `org.springframework:spring-core` from 7.0.9 to 7.0.10
- [Release notes](https://github.com/spring-projects/spring-framework/releases)
- [Commits](https://github.com/spring-projects/spring-framework/compare/v7.0.9...v7.0.10)

Updates `org.springframework:spring-beans` from 7.0.9 to 7.0.10
- [Release notes](https://github.com/spring-projects/spring-framework/releases)
- [Commits](https://github.com/spring-projects/spring-framework/compare/v7.0.9...v7.0.10)

Updates `org.springframework:spring-context` from 7.0.9 to 7.0.10
- [Release notes](https://github.com/spring-projects/spring-framework/releases)
- [Commits](https://github.com/spring-projects/spring-framework/compare/v7.0.9...v7.0.10)

Updates `org.springframework:spring-expression` from 7.0.9 to 7.0.10
- [Release notes](https://github.com/spring-projects/spring-framework/releases)
- [Commits](https://github.com/spring-projects/spring-framework/compare/v7.0.9...v7.0.10)

Updates `org.springframework:spring-beans` from 7.0.9 to 7.0.10
- [Release notes](https://github.com/spring-projects/spring-framework/releases)
- [Commits](https://github.com/spring-projects/spring-framework/compare/v7.0.9...v7.0.10)

Updates `org.springframework:spring-context` from 7.0.9 to 7.0.10
- [Release notes](https://github.com/spring-projects/spring-framework/releases)
- [Commits](https://github.com/spring-projects/spring-framework/compare/v7.0.9...v7.0.10)

Updates `org.springframework:spring-expression` from 7.0.9 to 7.0.10
- [Release notes](https://github.com/spring-projects/spring-framework/releases)
- [Commits](https://github.com/spring-projects/spring-framework/compare/v7.0.9...v7.0.10)

Updates `com.esotericsoftware:kryo` from 5.6.2 to 5.7.1
- [Release notes](https://github.com/EsotericSoftware/kryo/releases)
- [Commits](https://github.com/EsotericSoftware/kryo/compare/kryo-parent-5.6.2...kryo-parent-5.7.1)

Updates `com.github.mwiede:jsch` from 2.28.7 to 2.28.8
- [Release notes](https://github.com/mwiede/jsch/releases)
- [Changelog](https://github.com/mwiede/jsch/blob/master/ChangeLog)
- [Commits](https://github.com/mwiede/jsch/compare/jsch-2.28.7...jsch-2.28.8)

Updates `org.apache.mina:mina-core` from 2.2.9 to 2.2.10
- [Commits](https://github.com/apache/mina/compare/2.2.9...2.2.10)

Updates `org.restlet:org.restlet` from 2.6.0 to 2.6.1
- [Changelog](https://github.com/restlet/restlet-framework-java/blob/2.6.1/changes.md)
- [Commits](https://github.com/restlet/restlet-framework-java/compare/2.6.0...2.6.1)

Updates `org.restlet:org.restlet.ext.jetty` from 2.6.0 to 2.6.1

Updates `org.restlet:org.restlet.ext.xml` from 2.6.0 to 2.6.1
- [Changelog](https://github.com/restlet/restlet-framework-java/blob/2.6.1/changes.md)
- [Commits](https://github.com/restlet/restlet-framework-java/compare/2.6.0...2.6.1)

Updates `org.restlet:org.restlet.ext.json` from 2.6.0 to 2.6.1
- [Changelog](https://github.com/restlet/restlet-framework-java/blob/2.6.1/changes.md)
- [Commits](https://github.com/restlet/restlet-framework-java/compare/2.6.0...2.6.1)

Updates `org.restlet:org.restlet.ext.crypto` from 2.6.0 to 2.6.1
- [Changelog](https://github.com/restlet/restlet-framework-java/blob/2.6.1/changes.md)
- [Commits](https://github.com/restlet/restlet-framework-java/compare/2.6.0...2.6.1)

Updates `org.restlet:org.restlet.ext.xml` from 2.6.0 to 2.6.1
- [Changelog](https://github.com/restlet/restlet-framework-java/blob/2.6.1/changes.md)
- [Commits](https://github.com/restlet/restlet-framework-java/compare/2.6.0...2.6.1)

Updates `org.restlet:org.restlet.ext.json` from 2.6.0 to 2.6.1
- [Changelog](https://github.com/restlet/restlet-framework-java/blob/2.6.1/changes.md)
- [Commits](https://github.com/restlet/restlet-framework-java/compare/2.6.0...2.6.1)

Updates `org.restlet:org.restlet.ext.crypto` from 2.6.0 to 2.6.1
- [Changelog](https://github.com/restlet/restlet-framework-java/blob/2.6.1/changes.md)
- [Commits](https://github.com/restlet/restlet-framework-java/compare/2.6.0...2.6.1)

Updates `org.apache.kafka:kafka-clients` from 4.3.1 to 4.4.0

Updates `at.yawk.lz4:lz4-java` from 1.12.0 to 1.12.1
- [Release notes](https://github.com/yawkat/lz4-java/releases)
- [Changelog](https://github.com/yawkat/lz4-java/blob/main/CHANGES.md)
- [Commits](https://github.com/yawkat/lz4-java/compare/v1.12.0...v1.12.1)

Updates `com.google.code.gson:gson` from 2.14.0 to 2.15.0
- [Release notes](https://github.com/google/gson/releases)
- [Changelog](https://github.com/google/gson/blob/main/CHANGELOG.md)
- [Commits](https://github.com/google/gson/compare/gson-parent-2.14.0...gson-parent-2.15.0)

---
updated-dependencies:
- dependency-name: com.fasterxml.jackson:jackson-bom
  dependency-version: 2.22.4
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.eclipse.jetty:jetty-bom
  dependency-version: 12.0.40
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.eclipse.jetty.ee10:jetty-ee10-bom
  dependency-version: 12.0.40
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.eclipse.jetty.ee10:jetty-ee10-bom
  dependency-version: 12.0.40
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.apache.maven.plugins:maven-surefire-plugin
  dependency-version: 3.6.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.codehaus.mojo:versions-maven-plugin
  dependency-version: 2.23.0
  dependency-type: direct:development
  update-type: version-update:semver-minor
  dependency-group: minor-and-patch
- dependency-name: org.sonatype.central:central-publishing-maven-plugin
  dependency-version: 0.12.0
  dependency-type: direct:development
  update-type: version-update:semver-minor
  dependency-group: minor-and-patch
- dependency-name: commons-codec:commons-codec
  dependency-version: 1.23.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: minor-and-patch
- dependency-name: dnsjava:dnsjava
  dependency-version: 3.7.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: minor-and-patch
- dependency-name: org.springframework:spring-core
  dependency-version: 7.0.10
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.springframework:spring-beans
  dependency-version: 7.0.10
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.springframework:spring-context
  dependency-version: 7.0.10
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.springframework:spring-expression
  dependency-version: 7.0.10
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.springframework:spring-beans
  dependency-version: 7.0.10
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.springframework:spring-context
  dependency-version: 7.0.10
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.springframework:spring-expression
  dependency-version: 7.0.10
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: com.esotericsoftware:kryo
  dependency-version: 5.7.1
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: minor-and-patch
- dependency-name: com.github.mwiede:jsch
  dependency-version: 2.28.8
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.apache.mina:mina-core
  dependency-version: 2.2.10
  dependency-type: direct:development
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.restlet:org.restlet
  dependency-version: 2.6.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.restlet:org.restlet.ext.jetty
  dependency-version: 2.6.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.restlet:org.restlet.ext.xml
  dependency-version: 2.6.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.restlet:org.restlet.ext.json
  dependency-version: 2.6.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.restlet:org.restlet.ext.crypto
  dependency-version: 2.6.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.restlet:org.restlet.ext.xml
  dependency-version: 2.6.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.restlet:org.restlet.ext.json
  dependency-version: 2.6.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.restlet:org.restlet.ext.crypto
  dependency-version: 2.6.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: org.apache.kafka:kafka-clients
  dependency-version: 4.4.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: minor-and-patch
- dependency-name: at.yawk.lz4:lz4-java
  dependency-version: 1.12.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-and-patch
- dependency-name: com.google.code.gson:gson
  dependency-version: 2.15.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: minor-and-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-11-02 16:52:47 +09:00
Alex Osborne 65529301b5 Merge pull request #781 from internetarchive/adam/fix_amqp_consumer_leak
feat: Refactor AMQPUrlReceiver and AMQPProducer to improve recovery from network issues.
2026-10-20 00:36:15 +09:00
Adam Miller 6b3ab9c937 feat: Adds configuration to enable persistence of messages in the penumbra queue 2026-10-16 10:26:48 -07:00
Adam Miller 3a2865efb6 feat: add liveliness check to AMQP StarterRestarter. Reduce queue prefetch to 100 2026-10-15 15:44:20 -07:00
Adam Miller 428b35ed8e fix: stop AMQPProducer abandoning connections and channels
Abort connections and channels before replacing them, and in stop(), so
the client stops recovering what this producer no longer references.

Automatic recovery stays enabled here, unlike AMQPUrlReceiver: connect()
runs on the publishing thread under a lock, so making it the only recovery
path would block every ToeThread while the broker is down.
2026-10-14 16:16:41 -07:00