Commit Graph

Select branches

Hide Pull Requests

ARI-5439

adam/add-crawl-log-logging-to-extractoryoutubedl

adam/add_configurable_extractor_js_script_attribute_rules

adam/ait-add-crawl-log-logging-to-extractoryoutubedl

adam/fix_amqp_consumer_leak

adam/fix_configurable_js_extractor_strict_overlay

adam/fix_crawl_end_time_checkpoint_resumption

adam/knowledgable_extractorjs_extends_configurable_extractorjs

adam/restore-has-prerequisite-behavior

adam/strip_invalid_xml_chars_from_rest_api_output

adds-bdbmodule-max-file-size-option

adds-subqueue-support-forced-queue-assignment

adds-trough-dedup-performance-rework

adds-trough-local-dedup-write-cache

ait-qa

ait-ydl-updates

collectd-socket-stats-writer

fix-invoker-command-fallback

fix-yt-dlp-typo-too

fixes-WARCWriterChainProcessor-checkpoint-stats

fixes-extractor-multiple-regex-matcher-recycle

fixes-leaky-file-handles

fixes-prerequisite-status

fixes-trough-client-synchronization

fixes-trough-crawl-log-feed-synchronization

less_youtubedl

master

master-ait-contrib

master-it

meta-content-name

noplaylist-ydl

paged-log-viewer-search

restlet_npe

revert-367-fixes-trough-crawl-log-feed-synchronization

ydl-no-cache

yt-dl-format

yt-dl-format-medium-ish

yt-dlp

yt-dlp-20230706

yt-dlp-4-h3

yt-dlp-for-h3

#1

#1/merge

#10

#10/merge

#100

#101

#102

#103

#104

#105

#106

#107

#108

#109

#11

#11/merge

#110

#111

#112

#113

#114

#115

#116

#117

#118

#119

#12

#12/merge

#120

#121

#122

#123

#124

#125

#126

#127

#127/merge

#128

#129

#13

#13/merge

#130

#131

#132

#133

#134

#134/merge

#135

#136

#137

#138

#139

#14

#14/merge

#140

#140/merge

#141

#142

#143

#144

#145

#146

#147

#148

#149

#15

#15/merge

#150

#151

#152

#153

#153/merge

#154

#159

#16

#16/merge

#161

#163

#164

#165

#166

#168

#169

#17

#17/merge

#171

#174

#174/merge

#178

#179

#18

#180

#183

#183/merge

#184

#184/merge

#185

#186

#187

#188

#188/merge

#189

#19

#19/merge

#190

#192

#194

#196

#197

#2

#2/merge

#20

#20/merge

#205

#207

#209

#21

#21/merge

#210

#213

#215

#216

#217

#218

#219

#22

#22/merge

#220

#222

#223

#224

#226

#227

#23

#230

#231

#235

#238

#24

#240

#241

#242

#243

#244

#246

#248

#249

#25

#251

#253

#255

#256

#257

#26

#260

#262

#269

#27

#270

#271

#272

#273

#276

#28

#280

#281

#283

#285

#286

#287

#288

#289

#29

#290

#292

#292/merge

#294

#295

#296

#298

#3

#3/merge

#30

#300

#301

#302

#303

#304

#306

#308

#31

#310

#312

#313

#314

#315

#317

#32

#320

#323

#325

#326

#327

#328

#329

#33

#330

#331

#333

#334

#335

#336

#34

#341

#342

#345

#346

#347

#348

#349

#35

#352

#354

#355

#356

#357

#359

#36

#362

#364

#365

#366

#367

#368

#369

#37

#370

#373

#374

#375

#377

#379

#38

#381

#382

#383

#384

#385

#386

#388

#388/merge

#389

#39

#390

#391

#393

#394

#395

#397

#398

#399

#4

#4/merge

#40

#400

#401

#402

#403

#404

#405

#406

#407

#408

#409

#41

#410

#411

#412

#414

#415

#416

#418

#42

#421

#423

#424

#43

#431

#433

#434

#435

#44

#441

#442

#444

#445

#448

#45

#450

#452

#454

#456

#457

#459

#46

#460

#461

#465

#468

#47

#470

#475

#476

#478

#48

#480

#483

#484

#486

#488

#489

#49

#490

#491

#492

#493

#5

#5/merge

#50

#503

#51

#52

#53

#534

#535

#536

#537

#538

#539

#54

#542

#543

#544

#549

#55

#55/merge

#550

#551

#552

#554

#555

#56

#565

#566

#567

#57

#572

#573

#574

#575

#576

#577

#578

#579

#58

#580

#581

#582

#583

#586

#589

#59

#590

#591

#592

#593

#594

#595

#597

#598

#599

#6

#6/merge

#60

#600

#601

#602

#603

#605

#606

#607

#608

#609

#61

#610

#611

#612

#614

#615

#616

#617

#618

#619

#62

#621

#622

#623

#624

#625

#626

#627

#628

#629

#63

#630

#631

#632

#638

#639

#64

#640

#642

#643

#644

#645

#646

#647

#648

#649

#65

#650

#651

#652

#653

#654

#655

#656

#657

#659

#66

#660

#661

#663

#664

#665

#667

#668

#669

#67

#670

#671

#672

#673

#674

#675

#676

#677

#678

#679

#68

#680

#681

#682

#683

#684

#685

#686

#69

#691

#692

#693

#694

#695

#696

#697

#7

#7/merge

#70

#700

#701

#703

#704

#705

#706

#707

#708

#709

#71

#710

#712

#713

#719

#72

#721

#722

#723

#725

#728

#73

#730

#731

#732

#733

#734

#735

#736

#737

#738

#739

#74

#740

#741

#742

#744

#745

#746

#75

#750

#751

#755

#756

#757

#758

#759

#76

#760

#761

#761/merge

#762

#763

#764

#765

#766

#767

#77

#770

#771

#772

#774

#775

#776

#777

#778

#779

#78

#780

#781

#781/merge

#782

#783

#784

#785

#786

#787

#787/merge

#788

#79

#8

#8/merge

#80

#81

#82

#83

#84

#85

#85/merge

#86

#87

#88

#89

#9

#9/merge

#90

#91

#92

#93

#94

#95

#96

#97

#98

#98/merge

#99

3.0.0

3.1.1

3.10.0

3.10.1

3.10.2

3.11.0

3.12.0

3.13.0

3.14.0

3.14.1

3.15.0

3.16.0

3.17.0

3.17.1

3.18.0

3.2.0

3.4.0-20190205

3.4.0-20190207

3.4.0-20190418

3.4.0-20200304

3.4.0-20200518

3.4.0-20210527

3.4.0-20210617

3.4.0-20210618

3.4.0-20210621

3.4.0-20210803

3.4.0-20210923

3.4.0-20220727

3.4.0-20240909

3.5.0

3.6.0

3.7.0

3.8.0

3.9.0

Mono Color

• cc04602074 Bump the minor-and-patch group with 14 updates dependabot[bot] 2025-12-02 02:22:11 +00:00
• c65bc1bcc0 Merge branch 'internetarchive:master' into bnf_2025 Leslie Bellony 2025-12-01 10:21:11 +01:00
• da0fb468b2 Merge pull request #693 from manikyarathore/master_m2 Alex Osborne 2025-11-26 09:02:57 +09:00
• c46f3dd1e7 Merge pull request #691 from manikyarathore/master_manikya Alex Osborne 2025-11-26 08:58:19 +09:00
• e4523d63ee fix 690 issue Consolidate and log on deleting URIs from BdB database Manikya Rathore 2025-11-22 18:42:36 +05:30
• f75f40ab74 fix(cookie-store): normalize leading-dot domains in cookie.txt loader to resolve ignored cookies (#658) Manikya Rathore 2025-11-21 20:22:54 +05:30
• 79396af478 Issue #687 disable strictReplyParsing to accept server partial response Leslie Bellony 2025-11-18 12:18:34 +01:00
• d972ac47e0 Bump the minor-and-patch group with 3 updates dependabot[bot] 2025-11-01 23:26:31 +00:00
• ffad891b78 Bump com.github.mwiede:jsch in the minor-and-patch group dependabot[bot] 2025-10-30 01:48:07 +00:00
• bb62475ba0 CHANGELOG: Move completions feature to unreleased Alex Osborne 2025-10-30 10:45:13 +09:00
• 7c1b1639cb Merge pull request #684 from internetarchive/ato/autocomplete Alex Osborne 2025-10-30 10:42:19 +09:00
• ab41c7a658 [maven-release-plugin] prepare for next development iteration Alex Osborne 2025-10-30 10:25:16 +09:00
• b626f52d67 [maven-release-plugin] prepare release 3.12.0 3.12.0 Alex Osborne 2025-10-30 10:25:11 +09:00
• 89bd3474ba Add docgen/target to .gitignore Alex Osborne 2025-10-30 10:21:16 +09:00
• cf40d8513e Update CHANGELOG.md for 3.12.0 release Alex Osborne 2025-10-30 10:20:36 +09:00
• c0e5018eef Config editor: implement autocompletion Alex Osborne 2025-10-29 14:42:19 +09:00
• a76a91ac3b readthedocs: use mvn --batch-mode Alex Osborne 2025-10-28 16:50:00 +09:00
• 03b9c27247 Merge pull request #683 from internetarchive/ato/beandoc Alex Osborne 2025-10-28 16:32:52 +09:00
• 89e5ecc7d6 docs: replace javalang with an annotation processor Alex Osborne 2025-10-28 16:12:29 +09:00
• ab589e6b18 CI: Replace JDK 24 with 25 in build matrix Alex Osborne 2025-10-27 15:46:11 +09:00
• d627118307 Bump the minor-and-patch group across 1 directory with 18 updates (#680) dependabot[bot]andAlex Osborne 2025-10-27 15:42:40 +09:00
• 14cb366928 Bump org.junit.jupiter:junit-jupiter from 5.13.4 to 6.0.0 dependabot[bot] 2025-10-27 06:16:56 +00:00
• cbe879fb37 Bump org.apache.kafka:kafka-clients from 3.9.1 to 4.1.0 dependabot[bot] 2025-10-27 06:14:11 +00:00
• d5b40f580f dependabot: add ignore for net.htmlparser.jericho:jericho-html Alex Osborne 2025-10-27 15:15:25 +09:00
• 291164a09e dependabot: add ignore for com.sleepycat:je Alex Osborne 2025-10-27 15:14:35 +09:00
• d69dc04528 dependabot: add ignores for codemirror and jetty 12.1 Alex Osborne 2025-10-27 14:44:46 +09:00
• a50c012d2d Merge pull request #677 from internetarchive/dependabot/maven/org.apache.groovy-groovy-bom-5.0.2 Alex Osborne 2025-10-27 10:21:22 +09:00
• bfe45b25cd Merge pull request #675 from internetarchive/dependabot/maven/org.apache.maven.plugins-maven-surefire-plugin-3.5.4 Alex Osborne 2025-10-27 10:20:26 +09:00
• c50f4dc461 Bump org.apache.maven.plugins:maven-resources-plugin from 2.5 to 3.3.1 (#674) dependabot[bot] 2025-10-27 01:17:23 +00:00
• 8fe22b503c Bump org.apache.maven.plugins:maven-javadoc-plugin from 2.6.1 to 3.12.0 (#673) dependabot[bot] 2025-10-27 01:16:59 +00:00
• 6c25801d13 Bump org.apache.groovy:groovy-bom from 4.0.28 to 5.0.2 dependabot[bot] 2025-10-27 01:15:06 +00:00
• 237d19a5d4 Bump org.apache.maven.plugins:maven-surefire-plugin from 2.22.2 to 3.5.4 dependabot[bot] 2025-10-27 01:14:45 +00:00
• 3a27aeb37d Merge pull request #671 from internetarchive/adam/handle_more_bdb_shutdown_interrupts Alex Osborne 2025-10-27 10:06:20 +09:00
• dd11f87ce7 Enable dependabot updates monthly with minor updates grouped Alex Osborne 2025-10-27 10:05:16 +09:00
• 26bb59621b Merge pull request #672 from internetarchive/adam/add_configurable_extractor_js_script_attribute_rules Alex Osborne 2025-10-21 22:11:28 +09:00
• 8d09cc4e50 feat: Pass along script tag attributes to JS extractor for configurable rejection. adam/add_configurable_extractor_js_script_attribute_rules Adam Miller 2025-10-07 11:04:12 -07:00
• 558727ac37 fix handle more bdb shutdown interrupts Adam Miller 2025-10-03 17:17:46 -07:00
• 29d2d7919b Merge pull request #670 from internetarchive/adam/fix_configurable_js_extractor_strict_overlay Kristinn Sigurðsson 2025-10-01 08:35:50 +00:00
• e92475ac43 fix: sheet setting of extractorJs.strict doesn't work without kp keyname matching adam/fix_configurable_js_extractor_strict_overlay Adam Miller 2025-09-30 14:14:06 -07:00
• 978345c51a Merge pull request #669 from internetarchive/adam/fix_crawl_end_time_checkpoint_resumption Alex Osborne 2025-09-30 07:21:15 +10:00
• 38e7156ef6 fix: don't restore crawlEndTime when resuming from checkpoint. adam/fix_crawl_end_time_checkpoint_resumption Adam Miller 2025-09-25 10:50:47 -07:00
• b988940eff [maven-release-plugin] prepare for next development iteration Alex Osborne 2025-09-22 13:57:47 +09:00
• e3bdd7220e [maven-release-plugin] prepare release 3.11.0 3.11.0 Alex Osborne 2025-09-22 13:57:41 +09:00
• 41aa946adb Update CHANGELOG for 3.11.0 release Alex Osborne 2025-09-22 13:56:26 +09:00
• 25b621ce61 Bump jakarta.xml.bind-api from 4.0.2 to 4.0.4 Alex Osborne 2025-09-22 13:51:48 +09:00
• cb986a0ed2 Bump codemirror__language from 6.11.2 to 6.11.3 Alex Osborne 2025-09-22 13:50:01 +09:00
• e439f3568b Bump jetty from 12.0.25 to 12.0.27 Alex Osborne 2025-09-22 13:48:49 +09:00
• 1ed64142ea Bump jsch from 2.27.2 to 2.27.3 Alex Osborne 2025-09-22 13:46:42 +09:00
• 94c0daeec5 Bump spring from 6.2.10 to 6.2.11 Alex Osborne 2025-09-22 13:45:11 +09:00
• 95d74ab4e7 Bump gson from 2.13.1 to 2.13.2 Alex Osborne 2025-09-22 13:43:40 +09:00
• 5e2809f7c6 Merge pull request #668 from internetarchive/adam/knowledgable_extractorjs_extends_configurable_extractorjs Alex Osborne 2025-09-22 13:39:21 +09:00
• ec3cbe679f feat: KnowledgableExtractorJS extends ConfigurableExtractorJS to inherit new config options adam/knowledgable_extractorjs_extends_configurable_extractorjs Adam Miller 2025-09-18 15:13:01 -07:00
• 351cc2bea2 Update CHANGELOG.md for #667 Alex Osborne 2025-09-12 16:45:51 +09:00
• 96b6480f9c Merge pull request #667 from internetarchive/adam/strip_invalid_xml_chars_from_rest_api_output Alex Osborne 2025-09-12 16:38:55 +09:00
• fd2aed89fb feat: strip invalid chars from xml rest api output adam/strip_invalid_xml_chars_from_rest_api_output Adam Miller 2025-09-11 17:42:07 -07:00
• d484007f57 FetchHTTP2: Note that WARC doesn't specify the recording of HTTP/2 and 3 Alex Osborne 2025-09-06 10:29:24 +09:00
• 20dcc89244 [maven-release-plugin] prepare for next development iteration Alex Osborne 2025-08-29 17:26:11 +09:00
• 7a2c676dc9 [maven-release-plugin] prepare release 3.10.2 3.10.2 Alex Osborne 2025-08-29 17:26:05 +09:00
• de47ab97a6 Update CHANGELOG for 3.10.2 Alex Osborne 2025-08-29 17:21:13 +09:00
• 31539e2d62 Use Groovy BOM to ensure consistent versions Alex Osborne 2025-08-28 15:35:14 +09:00
• e42306ceb1 Use slf4j BOM to ensure consistent versions Alex Osborne 2025-08-28 15:32:48 +09:00
• bb04d1e0a9 Bump jetty from 12.0.22 to 12.0.25 Alex Osborne 2025-08-28 15:27:42 +09:00
• 3cde816e95 Use jetty BOM to ensure consistent versions Alex Osborne 2025-08-28 15:27:10 +09:00
• c79de0bec5 Merge pull request #665 from internetarchive/fetchdns-zero-addr Alex Osborne 2025-08-26 09:58:44 +09:00
• 219139e4e9 FetchDNS: Treat 0.0.0.0 as resolution failure Alex Osborne 2025-08-21 09:47:48 +09:00
• 3c6191fd5a Merge pull request #664 from internetarchive/deps Alex Osborne 2025-08-20 17:18:17 +09:00
• adaf44caf2 Add dependency upgrades to CHANGELOG Alex Osborne 2025-08-20 17:11:42 +09:00
• 30707296f6 Bump amqp-client from 5.25.0 to 5.26.0 Alex Osborne 2025-08-20 17:07:02 +09:00
• 148477b4d3 Bump commons-net from 3.11.1 to 3.12.0 Alex Osborne 2025-08-20 17:06:31 +09:00
• cbd72abfb7 Bump commons-codec from 1.18.0 to 1.19.0 Alex Osborne 2025-08-20 17:06:12 +09:00
• ab1c9bef5a Bump commons-cli from 1.9.0 to 1.10.0 Alex Osborne 2025-08-20 17:05:52 +09:00
• 8a481f719f Bump groovy from 4.0.27 to 4.0.28 Alex Osborne 2025-08-20 17:05:28 +09:00
• b1be6fbe0d Bump codemirror__view from 6.37.2 to 6.38.1 Alex Osborne 2025-08-20 17:05:03 +09:00
• 362a40f3db Bump spring from 6.2.9 to 6.2.10 Alex Osborne 2025-08-20 17:04:20 +09:00
• 7f1e734373 Bump junit-jupiter from 5.13.3 to 5.13.4 Alex Osborne 2025-08-20 17:04:07 +09:00
• e06ccbe70c versions-maven-plugin: ignore pre-release dependency versions Alex Osborne 2025-08-20 17:00:17 +09:00
• 5983f61626 Bump codemirror@legacy-modes from 6.5.0 to 6.5.1 Alex Osborne 2025-08-20 16:53:23 +09:00
• c8c2512e77 Bump codemirror@language from 6.11.1 to 6.11.2 Alex Osborne 2025-08-20 16:53:10 +09:00
• 194046d35b Merge pull request #663 from mistydemeo/misty/ampq_provide_user_agent Alex Osborne 2025-08-14 07:10:47 +09:00
• e8e3ad6ab5 AMQPPublishProcessor: pass along user agent Misty De Méo 2025-08-13 13:25:44 -07:00
• ea67b59e51 [maven-release-plugin] prepare for next development iteration Alex Osborne 2025-07-21 17:15:17 +09:00
• 1cf6762c7f [maven-release-plugin] prepare release 3.10.1 3.10.1 Alex Osborne 2025-07-21 17:15:12 +09:00
• d76a15089d Update CHANGELOG.md for 3.10.1 release Alex Osborne 2025-07-21 17:13:11 +09:00
• bb0cb1cea0 Bump spring from 6.2.7 to 6.2.9 Alex Osborne 2025-07-21 17:00:48 +09:00
• 2388db4229 Bump commons-lang from 2.6 to 3.18.0 Alex Osborne 2025-07-21 16:55:31 +09:00
• b41a95109c Bump jetty from 12.0.17 to 12.0.22 Alex Osborne 2025-07-21 16:15:21 +09:00
• fbc7489e61 Bump commons-io from 2.19.0 to 2.20.0 Alex Osborne 2025-07-21 16:12:59 +09:00
• 329bf1c741 Bump jsch from 2.27.0 to 2.27.2 Alex Osborne 2025-07-21 16:11:08 +09:00
• 53f154574d Bump crawler-commons from 1.4 to 1.5 Alex Osborne 2025-07-21 16:10:15 +09:00
• e121b71c52 Bump junit-jupiter from 5.13.2 to 5.13.3 Alex Osborne 2025-07-21 16:06:51 +09:00
• 8eaaa27ae7 Bump codemirror@search to 6.5.11 and codemirror@state to 6.37.2 Alex Osborne 2025-07-21 16:06:32 +09:00
• c45544a47b Bump restlet from 2.6.0-rc1 to 2.6.0 Alex Osborne 2025-07-21 16:03:24 +09:00
• 85ceab905c BrowserProcessor: create scratchDir on start Alex Osborne 2025-07-21 11:47:38 +09:00
• d7f5748fe0 Merge pull request #661 from internetarchive/seeds-report-redirect-extra-codes Alex Osborne 2025-07-15 14:54:12 +09:00
• 839a8f4604 Bump webarchive-commons from 2.0.1 to 2.0.2 Alex Osborne 2025-07-15 11:16:48 +09:00
• db63c7ec85 Seeds report: record redirect URI for statuses 303, 307 and 308 Alex Osborne 2025-06-30 22:24:29 +09:00
• acf41d598d FetchHTTP2: Use HTTP/1.1 when the server doesn't support ALPN Alex Osborne 2025-06-20 18:52:32 +09:00
• 8bfde99af3 FetchHTTP2: Handle getRemoteSocketAddress() returning null Alex Osborne 2025-06-20 17:27:32 +09:00
• b20d36f607 Add RELEASING.md Alex Osborne 2025-06-13 00:44:24 +09:00
• 18026bf66b Switch base image from deprecated openjdk to eclipse-temurin Alex Osborne 2025-06-12 23:55:07 +09:00