Adam Miller
c7784f18e9
feat: Add serializer for Histotable used by HighestUriPrecedenceProvider
2025-04-21 17:20:38 -07:00
Alex Osborne
e9b60404a6
[maven-release-plugin] prepare for next development iteration
2025-04-01 17:43:31 +09:00
Alex Osborne
2323e2251e
[maven-release-plugin] prepare release 3.8.0
2025-04-01 17:43:25 +09:00
Alex Osborne
edb3f3aa00
Merge pull request #645 from internetarchive/deps-3.8
...
Update dependencies and fix some warnings for 3.8.0 release
2025-04-01 17:41:02 +09:00
Alex Osborne
fb9b286d95
Update CHANGELOG for 3.8.0
2025-04-01 17:38:06 +09:00
Alex Osborne
575a2653b9
Fix warning: assert statement with side effects
2025-04-01 16:27:13 +09:00
Alex Osborne
b8dbe8bb2d
Remove unused utility class LogUtils
2025-04-01 16:25:44 +09:00
Alex Osborne
ed72112d9c
Fix missing try-with-resources warning
2025-04-01 16:19:58 +09:00
Alex Osborne
1a605cf9a6
Remove unused utility class JavaLiterals
...
Apache Commons StringEscapeUtils which we use for other things provides
this anyway.
2025-04-01 16:11:10 +09:00
Alex Osborne
13052a1465
Fix more broken references in javadoc
2025-04-01 16:06:10 +09:00
Alex Osborne
f956b2ec1f
Fix broken references in javadoc
2025-04-01 15:59:38 +09:00
Alex Osborne
7f76f5abd1
FetchHTTPTest: Disable testHostHeaderDefaultPort due to random failures
...
Probably some of the GitHub test runners are getting blocked.
2025-04-01 15:37:21 +09:00
Alex Osborne
b17e3fcab3
Bump beanshell from 2.0b5 to 2.0b6
2025-04-01 15:27:22 +09:00
Alex Osborne
7ff1078d21
Fix warning about implicit narrowing conversion for contentSinceCheck
2025-03-31 15:31:04 +09:00
Alex Osborne
f17000e14f
Fix warning: Building a command line with string concatenation
2025-03-31 15:17:28 +09:00
Alex Osborne
60f512b4b0
Fix compiler warning: deprecated item is not annotated with @Deprecated
2025-03-31 15:12:21 +09:00
Alex Osborne
f6b083ecfb
Remove usages of deprecated Integer and Long constructors
2025-03-31 15:04:00 +09:00
Alex Osborne
1288e78c54
Bump spring from 6.1.16 to 6.2.5
2025-03-31 14:58:13 +09:00
Alex Osborne
b9bfd36d28
Bump dnsjava from 3.6.2 to 3.6.3
2025-03-31 14:53:01 +09:00
Alex Osborne
4688d8cda2
Bump commons-codec from 1.17.2 to 1.18.0
2025-03-31 14:52:42 +09:00
Alex Osborne
5ecfa7248c
Bump jsch from 0.2.22 to 0.2.24
2025-03-31 14:52:25 +09:00
Alex Osborne
77b92c9da8
Bump groovy from 4.0.24 to 4.0.26
2025-03-31 14:52:00 +09:00
Alex Osborne
e9227e7f84
Bump pdfbox from 3.0.3 to 3.0.4
2025-03-31 14:51:40 +09:00
Alex Osborne
a56bec5e82
Bump slf4j from 2.0.16 to 2.0.17
2025-03-31 14:51:05 +09:00
Alex Osborne
78edc0a0c3
Bump amqp-client from 5.24.0 to 5.25.0
2025-03-31 14:47:57 +09:00
Alex Osborne
101070c2be
Bump gson from 2.11.0 to 2.12.1
2025-03-31 14:47:29 +09:00
Alex Osborne
3f323bb0da
Remove pillow from docs requirements.txt
...
It's triggering dependabot alerts and it appears as if we don't
actually use it.
2025-03-21 13:23:03 +09:00
Alex Osborne
a7c2f826b9
Update CI tests from JDK 23 to 24
2025-03-21 13:19:44 +09:00
Alex Osborne
ace2ab80e8
Merge pull request #644 from adam-miller/adam/parameterize-yt-dlp-process-command
...
feat: Parameterize yt-dlp process command arguments
2025-03-18 11:39:53 +09:00
Adam Miller
710662fcd0
fix: Copy process arguments to mutable list to append url.
2025-03-17 14:38:59 -07:00
Adam Miller
82bde56dc0
Merge branch 'master' into adam/parameterize-yt-dlp-process-command
2025-03-17 09:34:23 -07:00
Alex Osborne
cc1a668abd
Merge pull request #643 from adam-miller/adam/fix-optional-bdb-test-exception
...
fix: ObjectIdentityBdbManualCacheTest.java fails with -DrunSlowTests=…
2025-03-15 09:42:21 +09:00
Adam Miller
363f90b443
feat: Add a parameter to override default yt-dlp process arguments
2025-03-14 17:23:29 -07:00
Adam Miller
b02590cca0
Use AtomicInteger serializer rather than change accessibility
2025-03-14 09:14:26 -07:00
Adam Miller
829c283ab2
fix: ObjectIdentityBdbManualCacheTest.java fails with -DrunSlowTests=true on Java 9+
2025-03-13 16:00:39 -07:00
Alex Osborne
86473021d9
Update GitHub actions to use actions/cache@v4
...
https://github.blog/changelog/2024-12-05-notice-of-upcoming-releases-and-breaking-changes-for-github-actions/#actions-cache-v1-v2-and-actions-toolkit-cache-package-closing-down
Thanks to Sebastian Nagel for the heads up.
2025-03-12 00:03:48 +09:00
Alex Osborne
22f8f7f754
Restore accidentally removed word
2025-02-14 11:29:22 +09:00
Alex Osborne
88854d8dfd
Add caption to deciderule extlinks
...
It seems to be failing because the placeholder is missing:
```
File "/home/docs/checkouts/readthedocs.org/user_builds/heritrix/envs/latest/lib/python3.12/site-packages/sphinx/ext/extlinks.py", line 103, in role
title = caption % part
~~~~~~~~^~~~~~
TypeError: not all arguments converted during string formatting
```
2025-02-14 11:23:02 +09:00
Alex Osborne
71c2fdb618
Add missing readthedocs dependencies
...
https://blog.readthedocs.com/defaulting-latest-build-tools/
2025-02-14 11:15:35 +09:00
Alex Osborne
ac33072991
Add build section .readthedocs.yml
...
Contrary to the example in the announcement it seems to be mandatory:
> Config validation error in build.os. Value build not found.
2025-02-14 11:12:32 +09:00
Alex Osborne
657eb582c6
Add .readthedocs.yml
...
https://about.readthedocs.com/blog/2024/12/deprecate-config-files-without-sphinx-or-mkdocs-config/
#634
2025-02-14 11:10:09 +09:00
Alex Osborne
d21a053c6d
[maven-release-plugin] prepare for next development iteration
2025-02-03 14:11:22 +09:00
Alex Osborne
370f0480e5
[maven-release-plugin] prepare release 3.7.0
2025-02-03 14:11:18 +09:00
Alex Osborne
8cf3e476d1
Bump ftpserver-core from 1.2.0 to 1.2.1
2025-02-03 14:08:51 +09:00
Alex Osborne
ed02038e8b
Update CHANGELOG for 3.7.0
2025-02-03 14:05:51 +09:00
Alex Osborne
48ac7484f0
Merge pull request #639 from internetarchive/update-deps-for-3.7
...
Update dependencies for 3.7.0 release
2025-02-03 12:02:16 +09:00
Alex Osborne
42e4151bc6
Merge pull request #640 from internetarchive/suppress-cookie-rejected-logging
...
Suppress 'WARNING Cookie rejected' messages in job.log
2025-02-03 12:01:55 +09:00
Alex Osborne
cd3f3f9e09
Suppress 'WARNING Cookie rejected' messages in job.log
...
These log messages started unhelpfully being copied into job.log in
3.6.0 due to the slf4j fix. They indicate the server sent a set-cookie
header with an incorrect domain. It's correct for Heritrix to reject
them. They're very common and not an indication of a problem with
Heritrix itself so it's unnecessarily alarming to log them as
job warnings.
Fixes: 533d762db5
2025-01-23 22:12:14 +09:00
Alex Osborne
3c5074da39
Bump spring from 6.1.15 to 6.1.16
2025-01-23 14:05:32 +09:00
Alex Osborne
c54684279f
Bump commons-codec from 1.17.1 to 1.17.2
2025-01-23 14:05:32 +09:00
Adam Miller