Commit Graph

Select branches

Hide Pull Requests

ARI-5439

adam/add-crawl-log-logging-to-extractoryoutubedl

adam/add_configurable_extractor_js_script_attribute_rules

adam/ait-add-crawl-log-logging-to-extractoryoutubedl

adam/fix_amqp_consumer_leak

adam/fix_configurable_js_extractor_strict_overlay

adam/fix_crawl_end_time_checkpoint_resumption

adam/knowledgable_extractorjs_extends_configurable_extractorjs

adam/restore-has-prerequisite-behavior

adam/strip_invalid_xml_chars_from_rest_api_output

adds-bdbmodule-max-file-size-option

adds-subqueue-support-forced-queue-assignment

adds-trough-dedup-performance-rework

adds-trough-local-dedup-write-cache

ait-qa

ait-ydl-updates

collectd-socket-stats-writer

fix-invoker-command-fallback

fix-yt-dlp-typo-too

fixes-WARCWriterChainProcessor-checkpoint-stats

fixes-extractor-multiple-regex-matcher-recycle

fixes-leaky-file-handles

fixes-prerequisite-status

fixes-trough-client-synchronization

fixes-trough-crawl-log-feed-synchronization

less_youtubedl

master

master-ait-contrib

master-it

meta-content-name

noplaylist-ydl

paged-log-viewer-search

restlet_npe

revert-367-fixes-trough-crawl-log-feed-synchronization

ydl-no-cache

yt-dl-format

yt-dl-format-medium-ish

yt-dlp

yt-dlp-20230706

yt-dlp-4-h3

yt-dlp-for-h3

#1

#1/merge

#10

#10/merge

#100

#101

#102

#103

#104

#105

#106

#107

#108

#109

#11

#11/merge

#110

#111

#112

#113

#114

#115

#116

#117

#118

#119

#12

#12/merge

#120

#121

#122

#123

#124

#125

#126

#127

#127/merge

#128

#129

#13

#13/merge

#130

#131

#132

#133

#134

#134/merge

#135

#136

#137

#138

#139

#14

#14/merge

#140

#140/merge

#141

#142

#143

#144

#145

#146

#147

#148

#149

#15

#15/merge

#150

#151

#152

#153

#153/merge

#154

#159

#16

#16/merge

#161

#163

#164

#165

#166

#168

#169

#17

#17/merge

#171

#174

#174/merge

#178

#179

#18

#180

#183

#183/merge

#184

#184/merge

#185

#186

#187

#188

#188/merge

#189

#19

#19/merge

#190

#192

#194

#196

#197

#2

#2/merge

#20

#20/merge

#205

#207

#209

#21

#21/merge

#210

#213

#215

#216

#217

#218

#219

#22

#22/merge

#220

#222

#223

#224

#226

#227

#23

#230

#231

#235

#238

#24

#240

#241

#242

#243

#244

#246

#248

#249

#25

#251

#253

#255

#256

#257

#26

#260

#262

#269

#27

#270

#271

#272

#273

#276

#28

#280

#281

#283

#285

#286

#287

#288

#289

#29

#290

#292

#292/merge

#294

#295

#296

#298

#3

#3/merge

#30

#300

#301

#302

#303

#304

#306

#308

#31

#310

#312

#313

#314

#315

#317

#32

#320

#323

#325

#326

#327

#328

#329

#33

#330

#331

#333

#334

#335

#336

#34

#341

#342

#345

#346

#347

#348

#349

#35

#352

#354

#355

#356

#357

#359

#36

#362

#364

#365

#366

#367

#368

#369

#37

#370

#373

#374

#375

#377

#379

#38

#381

#382

#383

#384

#385

#386

#388

#388/merge

#389

#39

#390

#391

#393

#394

#395

#397

#398

#399

#4

#4/merge

#40

#400

#401

#402

#403

#404

#405

#406

#407

#408

#409

#41

#410

#411

#412

#414

#415

#416

#418

#42

#421

#423

#424

#43

#431

#433

#434

#435

#44

#441

#442

#444

#445

#448

#45

#450

#452

#454

#456

#457

#459

#46

#460

#461

#465

#468

#47

#470

#475

#476

#478

#48

#480

#483

#484

#486

#488

#489

#49

#490

#491

#492

#493

#5

#5/merge

#50

#503

#51

#52

#53

#534

#535

#536

#537

#538

#539

#54

#542

#543

#544

#549

#55

#55/merge

#550

#551

#552

#554

#555

#56

#565

#566

#567

#57

#572

#573

#574

#575

#576

#577

#578

#579

#58

#580

#581

#582

#583

#586

#589

#59

#590

#591

#592

#593

#594

#595

#597

#598

#599

#6

#6/merge

#60

#600

#601

#602

#603

#605

#606

#607

#608

#609

#61

#610

#611

#612

#614

#615

#616

#617

#618

#619

#62

#621

#622

#623

#624

#625

#626

#627

#628

#629

#63

#630

#631

#632

#638

#639

#64

#640

#642

#643

#644

#645

#646

#647

#648

#649

#65

#650

#651

#652

#653

#654

#655

#656

#657

#659

#66

#660

#661

#663

#664

#665

#667

#668

#669

#67

#670

#671

#672

#673

#674

#675

#676

#677

#678

#679

#68

#680

#681

#682

#683

#684

#685

#686

#69

#691

#692

#693

#694

#695

#696

#697

#7

#7/merge

#70

#700

#701

#703

#704

#705

#706

#707

#708

#709

#71

#710

#712

#713

#719

#72

#721

#722

#723

#725

#728

#73

#730

#731

#732

#733

#734

#735

#736

#737

#738

#739

#74

#740

#741

#742

#744

#745

#746

#75

#750

#751

#755

#756

#757

#758

#759

#76

#760

#761

#761/merge

#762

#763

#764

#765

#766

#767

#77

#770

#771

#772

#774

#775

#776

#777

#778

#779

#78

#780

#781

#781/merge

#782

#783

#784

#785

#786

#787

#787/merge

#79

#8

#8/merge

#80

#81

#82

#83

#84

#85

#85/merge

#86

#87

#88

#89

#9

#9/merge

#90

#91

#92

#93

#94

#95

#96

#97

#98

#98/merge

#99

3.0.0

3.1.1

3.10.0

3.10.1

3.10.2

3.11.0

3.12.0

3.13.0

3.14.0

3.14.1

3.15.0

3.16.0

3.17.0

3.17.1

3.18.0

3.2.0

3.4.0-20190205

3.4.0-20190207

3.4.0-20190418

3.4.0-20200304

3.4.0-20200518

3.4.0-20210527

3.4.0-20210617

3.4.0-20210618

3.4.0-20210621

3.4.0-20210803

3.4.0-20210923

3.4.0-20220727

3.4.0-20240909

3.5.0

3.6.0

3.7.0

3.8.0

3.9.0

Mono Color

• f4f88a4335 BotBlockDetector: add azure-waf and vercel (#784) master Alex Osborne 2026-10-09 08:32:00 +09:00
• 7cdb1d5ed9 Bump com.rabbitmq:amqp-client (#786) dependabot[bot] 2026-10-09 08:31:29 +09:00
• 94a6761a17 BrowserProcessorTest: make tempDir static (#785) Alex Osborne 2026-10-08 18:36:09 +09:00
• 8bb0a65349 Merge pull request #783 from internetarchive/toethread-always-end-disposition Alex Osborne 2026-10-07 12:42:19 +09:00
• d6747686e3 Don't let browsers cache job directory files for 10 minutes (#782) Alex Osborne 2026-10-07 12:42:02 +09:00
• be6b49fa6c [maven-release-plugin] prepare for next development iteration Alex Osborne 2026-10-06 12:39:19 +09:00
• eac2c96daf [maven-release-plugin] prepare release 3.18.0 3.18.0 Alex Osborne 2026-10-06 12:39:12 +09:00
• dbbd820305 Add release notes for 3.18.0 Alex Osborne 2026-10-06 12:21:40 +09:00
• 7939d0d7e1 Reject cross-site requests to the web UI Alex Osborne 2026-10-06 12:21:40 +09:00
• 55bef0aa32 Merge pull request #780 from internetarchive/paged-log-viewer-search Alex Osborne 2026-10-06 12:09:09 +09:00
• 6f9a82c8fb Fix HTML escaping in templates paged-log-viewer-search Alex Osborne 2026-10-06 12:04:23 +09:00
• a09f38570d Only write heritrix_dmesg.log when requested (#779) Alex Osborne 2026-10-06 11:29:51 +09:00
• 0ca9e5dc2a Merge pull request #778 from internetarchive/ato/botblock-detector2 Alex Osborne 2026-10-06 11:20:02 +09:00
• bff9113895 fix: make AMQPUrlReceiver resilient to dropped connections adam/fix_amqp_consumer_leak Adam Miller 2026-10-05 17:27:30 -07:00
• f5070f6203 Paged log viewer: search and filter with a small query language Alex OsborneandClaude Opus 5.5 2026-10-02 16:46:36 +09:00
• b1a36159ae Paged log viewer: view a log together with its checkpoint generations Alex OsborneandClaude Opus 5.5 2026-10-02 16:46:36 +09:00
• 838523d33a BotBlockDetector: enable in default profiles Alex Osborne 2026-10-02 09:24:44 +09:00
• 4f26ed82f2 Bump actions/setup-java from 6.0.0 to 6.0.1 dependabot[bot] 2026-10-01 23:38:24 +00:00
• c36460a0f3 Bump the minor-and-patch group with 13 updates dependabot[bot] 2026-10-01 23:38:55 +00:00
• a0771568c2 Bump org.apache.groovy:groovy-bom from 5.1.1 to 6.0.0 dependabot[bot] 2026-10-01 23:39:19 +00:00
• a19bd61a33 BotBlockDetector: add aws-waf, kasada, lua-anti-ddos, perimeterx Alex Osborne 2026-10-02 08:25:52 +09:00
• 022f1d8050 Bump jackson-bom from 2.22.2 to 2.22.3 Alex Osborne 2026-10-02 07:44:30 +09:00
• f6a14ac1f6 Implement invoker commands for older browsers like Firefox ESR Alex Osborne 2026-09-30 12:53:18 +09:00
• 3321387d4f Implement invoker commands for older browsers like Firefox ESR fix-invoker-command-fallback Alex Osborne 2026-09-30 12:53:18 +09:00
• 16deaaf4eb Decode JavaScript Unicode code-point escapes in extracted URLs (#772) Shubham Padkonde 2026-09-22 13:51:42 +05:30
• ed2805f6b7 Extract URIs nested inside JSON arrays (#771) Francesco Marinoni Moretto 2026-09-22 10:16:43 +02:00
• 89294d11ba Merge pull request #770 from internetarchive/ato/fix-chunked-digest Alex Osborne 2026-09-17 17:20:59 +09:00
• 6c32aaa8c1 FetchHTTP: digest chunked responses after transfer decoding Alex Osborne 2026-09-15 10:10:43 +09:00
• abd17fa3c7 Merge pull request #767 from internetarchive/adam/improve_amqp_url_parsing Alex Osborne 2026-09-14 14:55:37 +09:00
• d15311698e chore: refactor AMQPUrlReceiver parsing to handle null values coming from different json libraries. Adam Miller 2026-09-10 14:56:48 -07:00
• 0d3582a136 [maven-release-plugin] prepare for next development iteration Alex Osborne 2026-09-10 17:29:57 +09:00
• 48f9c37f83 [maven-release-plugin] prepare release 3.17.1 3.17.1 Alex Osborne 2026-09-10 17:29:50 +09:00
• 3405087a6c Update CHANGELOG.md for 3.17.1 Alex Osborne 2026-09-10 17:25:21 +09:00
• 2fda0a0021 Merge pull request #766 from bnfleb/issue748 Alex Osborne 2026-09-10 08:07:05 +09:00
• b0beb39518 Call tallySourceStats only if the URI is effectively crawled Leslie Bellony 2026-09-09 17:12:29 +02:00
• ac615ae6f5 Merge pull request #765 from bnfleb/issue752 Alex Osborne 2026-09-09 14:22:13 +09:00
• 7b43a91e38 Include Heritrix status code in extended SourceTags report Leslie Bellony 2026-09-08 11:13:33 +02:00
• 33984a68d2 Issue #752 new Heritrix status for SSLHandshakeException Leslie Bellony 2026-09-08 10:56:57 +02:00
• f261b5beec Bump the minor-and-patch group with 2 updates dependabot[bot] 2026-09-01 23:41:52 +00:00
• c1c9f92b8c Bump actions/setup-java from 5.6.0 to 6.0.0 dependabot[bot] 2026-09-01 23:38:26 +00:00
• b5f32616c8 Fix javadoc warnings Alex Osborne 2026-08-25 11:02:15 +09:00
• 527b202752 [maven-release-plugin] prepare for next development iteration Alex Osborne 2026-08-25 10:17:24 +09:00
• 6eeb779923 [maven-release-plugin] prepare release 3.17.0 3.17.0 Alex Osborne 2026-08-25 10:17:12 +09:00
• e9d245837a Update CHANGELOG.md for 3.17.0 Alex Osborne 2026-08-25 10:11:55 +09:00
• 8b0755eadd Bump webarchive-commons from 3.0.4 to 3.0.5 Alex Osborne 2026-08-25 09:53:22 +09:00
• c419ad3ce5 Merge pull request #762 from internetarchive/dependabot/maven/minor-and-patch-3ea853afca Alex Osborne 2026-08-25 09:48:29 +09:00
• 1ece1be25c Bump the minor-and-patch group with 14 updates dependabot[bot] 2026-08-25 00:40:49 +00:00
• 38f88e5b16 Merge pull request #760 from internetarchive/ato/botblock-detector Alex Osborne 2026-08-21 09:31:06 +09:00
• cd4f910c57 BotBlockDetector: Look for cf-mitigated without server header Alex Osborne 2026-08-19 09:54:26 +09:00
• 9973a9f2f0 BotBlockDetector: Add DataDome Alex Osborne 2026-08-19 09:39:53 +09:00
• cec6cfbb64 Add BotBlockDetector Alex Osborne 2026-08-18 16:02:07 +09:00
• dea9227de4 Merge pull request #759 from bnfleb/issue753 Alex Osborne 2026-08-05 12:09:02 +09:00
• 78cc54eb1f Issue #753 verify if bdb is started before generating reports Leslie Bellony 2026-08-04 18:36:16 +02:00
• 96b16d0e68 Add mina-core 2.2.9 as explicit dependency Alex Osborne 2026-08-04 16:53:36 +09:00
• 26e8891e97 Merge pull request #758 from bnfleb/issue748 Alex Osborne 2026-08-04 16:45:58 +09:00
• 71bffa42e6 Issue #748 extend SourceTags report with status code Leslie Bellony 2026-08-03 14:25:53 +02:00
• 4f3980aad2 Merge pull request #757 from bnfleb/issue747 Alex Osborne 2026-08-03 19:21:24 +09:00
• 58054b962d Issue #747 add heritrix response codes in ResponseCode report Leslie Bellony 2026-08-03 11:18:11 +02:00
• 1a7dc27387 Merge pull request #755 from internetarchive/dependabot/github_actions/actions/setup-java-5.6.0 Alex Osborne 2026-08-03 17:03:26 +09:00
• 61a099c415 Merge pull request #756 from internetarchive/dependabot/maven/minor-and-patch-1f48d049a8 Alex Osborne 2026-08-03 17:03:10 +09:00
• b1b07fc477 Bump the minor-and-patch group with 21 updates dependabot[bot] 2026-08-01 23:41:17 +00:00
• 12006c5618 Bump actions/setup-java from 5 to 5.6.0 dependabot[bot] 2026-08-01 23:36:10 +00:00
• 10ebb393df Merge pull request #750 from internetarchive/browser-processor-reliability Alex Osborne 2026-07-15 14:07:03 +09:00
• 1c9b064f26 Merge pull request #751 from adam-miller/adam/fix_warc_writer_chain_null_via_check Alex Osborne 2026-07-14 14:25:48 +09:00
• fa4184928f fix: Add null check to curi.getVia() before isNotBlank() check Adam Miller 2026-07-13 16:57:06 -07:00
• 58258eb640 BiDiJson: map results to null for commands that return Void Alex Osborne 2026-07-10 16:05:27 +09:00
• 97d8307420 BrowserProcessor: restart the browser automatically if it crashes Alex Osborne 2026-07-10 14:55:09 +09:00
• d7676b1b67 BrowserProcessor: log failures continuing intercepted requests Alex Osborne 2026-07-10 14:54:43 +09:00
• 1b107f06c1 BrowserProcessor: guard stop() against a partially failed start() Alex Osborne 2026-07-10 14:54:19 +09:00
• d03a43266a BrowserProcessor: catch tab close failures Alex Osborne 2026-07-10 14:53:53 +09:00
• e276d83f4b BrowserProcessor: avoid NPE when a WebDriverException has no message Alex Osborne 2026-07-10 14:53:15 +09:00
• 1392da4fa6 LocalWebDriverBiDi: make close() reliably terminate the browser Alex Osborne 2026-07-10 14:51:45 +09:00
• 27d0f05010 LocalWebDriverBiDi: time out and clean up if the browser fails to start Alex Osborne 2026-07-10 11:29:36 +09:00
• 99cd6d942d LocalWebDriverBiDi: fail pending commands when the connection is lost Alex Osborne 2026-07-10 11:28:47 +09:00
• 4b396426e5 LocalWebDriverBiDi: serialize WebSocket sends Alex Osborne 2026-07-10 11:27:47 +09:00
• b68042158b RELEASING: Move docker image build after GitHub release Alex Osborne 2026-07-03 11:04:51 +09:00
• d42e1405a0 RELEASING.md: add steps to upload distribution artifacts to Github release Alex Osborne 2026-07-03 10:50:34 +09:00
• 79ec034562 Update distribution package links to Github for 3.16.0 Alex Osborne 2026-07-03 10:42:24 +09:00
• 789603c1b7 [maven-release-plugin] prepare for next development iteration Alex Osborne 2026-07-03 10:20:27 +09:00
• 7af0bf56ea [maven-release-plugin] prepare release 3.16.0 3.16.0 Alex Osborne 2026-07-03 10:20:16 +09:00
• df1fdb3593 Exclude dist artifacts from Maven Central release bundle Alex Osborne 2026-07-03 10:10:13 +09:00
• dafcc2ef14 RELEASING.md: set version dynamically based on last tag Alex Osborne 2026-07-03 10:06:39 +09:00
• 6c7a54b5c5 [maven-release-plugin] prepare for next development iteration Alex Osborne 2026-07-03 08:49:28 +09:00
• 9fdd5543af [maven-release-plugin] prepare release 3.16.0 Alex Osborne 2026-07-03 08:49:14 +09:00
• 7846215a0e Update CHANGELOG for 3.16.0 release Alex Osborne 2026-07-03 08:44:58 +09:00
• 0b451ed437 Update CHANGELOG for 3.16.0 release Alex Osborne 2026-07-03 08:35:00 +09:00
• 5ada2a784a Merge pull request #744 from internetarchive/dependabot/github_actions/actions/cache-6 Alex Osborne 2026-07-02 08:53:40 +09:00
• 987ba1ac46 Merge pull request #745 from internetarchive/dependabot/github_actions/actions/checkout-7 Alex Osborne 2026-07-02 08:53:22 +09:00
• 9ee5b4285b Merge pull request #746 from internetarchive/dependabot/maven/minor-and-patch-607f52c7b4 Alex Osborne 2026-07-02 08:53:07 +09:00
• 52de3d940c Bump the minor-and-patch group with 3 updates dependabot[bot] 2026-07-01 23:40:25 +00:00
• a0eb9e5eac Bump actions/checkout from 6 to 7 dependabot[bot] 2026-07-01 23:37:47 +00:00
• d63e5c710d Bump actions/cache from 5 to 6 dependabot[bot] 2026-07-01 23:37:44 +00:00
• 6344f8fdcf Merge pull request #742 from internetarchive/ato/BrowserProcessor-fixes Alex Osborne 2026-06-19 14:29:34 +09:00
• 1f145f7926 CI: try running browser tests Alex Osborne 2026-06-18 23:50:34 +09:00
• d3da2f9afe BrowserProcessor: handle result.isFailed() in SubresourceRecorder.onComplete() Alex Osborne 2026-06-18 23:30:48 +09:00
• 2c9f167ae3 BrowserProcessor: handle recording truncation with length and timeout limits Alex Osborne 2026-06-18 23:25:20 +09:00
• 4cb48ec5dc BrowserProcessor: fix content digest and recording limits for subresources Alex Osborne 2026-06-18 23:18:23 +09:00
• ff6f98d38d BrowserProcessor: set User-Agent header Alex Osborne 2026-06-18 23:00:21 +09:00
• 3b468c05c9 Merge pull request #737 from internetarchive/ato/fix-mitmproxy-request-content Alex Osborne 2026-06-18 09:36:10 +09:00
• b1c1f1f207 Bump the minor-and-patch group with 6 updates dependabot[bot] 2026-06-17 08:07:26 +00:00