Commit Graph

Select branches

Hide Pull Requests

ARI-5439

adam/add-crawl-log-logging-to-extractoryoutubedl

adam/add_configurable_extractor_js_script_attribute_rules

adam/ait-add-crawl-log-logging-to-extractoryoutubedl

adam/fix_amqp_consumer_leak

adam/fix_configurable_js_extractor_strict_overlay

adam/fix_crawl_end_time_checkpoint_resumption

adam/knowledgable_extractorjs_extends_configurable_extractorjs

adam/restore-has-prerequisite-behavior

adam/strip_invalid_xml_chars_from_rest_api_output

adds-bdbmodule-max-file-size-option

adds-subqueue-support-forced-queue-assignment

adds-trough-dedup-performance-rework

adds-trough-local-dedup-write-cache

ait-qa

ait-ydl-updates

collectd-socket-stats-writer

fix-invoker-command-fallback

fix-yt-dlp-typo-too

fixes-WARCWriterChainProcessor-checkpoint-stats

fixes-extractor-multiple-regex-matcher-recycle

fixes-leaky-file-handles

fixes-prerequisite-status

fixes-trough-client-synchronization

fixes-trough-crawl-log-feed-synchronization

less_youtubedl

master

master-ait-contrib

master-it

meta-content-name

noplaylist-ydl

paged-log-viewer-search

restlet_npe

revert-367-fixes-trough-crawl-log-feed-synchronization

ydl-no-cache

yt-dl-format

yt-dl-format-medium-ish

yt-dlp

yt-dlp-20230706

yt-dlp-4-h3

yt-dlp-for-h3

#1

#1/merge

#10

#10/merge

#100

#101

#102

#103

#104

#105

#106

#107

#108

#109

#11

#11/merge

#110

#111

#112

#113

#114

#115

#116

#117

#118

#119

#12

#12/merge

#120

#121

#122

#123

#124

#125

#126

#127

#127/merge

#128

#129

#13

#13/merge

#130

#131

#132

#133

#134

#134/merge

#135

#136

#137

#138

#139

#14

#14/merge

#140

#140/merge

#141

#142

#143

#144

#145

#146

#147

#148

#149

#15

#15/merge

#150

#151

#152

#153

#153/merge

#154

#159

#16

#16/merge

#161

#163

#164

#165

#166

#168

#169

#17

#17/merge

#171

#174

#174/merge

#178

#179

#18

#180

#183

#183/merge

#184

#184/merge

#185

#186

#187

#188

#188/merge

#189

#19

#19/merge

#190

#192

#194

#196

#197

#2

#2/merge

#20

#20/merge

#205

#207

#209

#21

#21/merge

#210

#213

#215

#216

#217

#218

#219

#22

#22/merge

#220

#222

#223

#224

#226

#227

#23

#230

#231

#235

#238

#24

#240

#241

#242

#243

#244

#246

#248

#249

#25

#251

#253

#255

#256

#257

#26

#260

#262

#269

#27

#270

#271

#272

#273

#276

#28

#280

#281

#283

#285

#286

#287

#288

#289

#29

#290

#292

#292/merge

#294

#295

#296

#298

#3

#3/merge

#30

#300

#301

#302

#303

#304

#306

#308

#31

#310

#312

#313

#314

#315

#317

#32

#320

#323

#325

#326

#327

#328

#329

#33

#330

#331

#333

#334

#335

#336

#34

#341

#342

#345

#346

#347

#348

#349

#35

#352

#354

#355

#356

#357

#359

#36

#362

#364

#365

#366

#367

#368

#369

#37

#370

#373

#374

#375

#377

#379

#38

#381

#382

#383

#384

#385

#386

#388

#388/merge

#389

#39

#390

#391

#393

#394

#395

#397

#398

#399

#4

#4/merge

#40

#400

#401

#402

#403

#404

#405

#406

#407

#408

#409

#41

#410

#411

#412

#414

#415

#416

#418

#42

#421

#423

#424

#43

#431

#433

#434

#435

#44

#441

#442

#444

#445

#448

#45

#450

#452

#454

#456

#457

#459

#46

#460

#461

#465

#468

#47

#470

#475

#476

#478

#48

#480

#483

#484

#486

#488

#489

#49

#490

#491

#492

#493

#5

#5/merge

#50

#503

#51

#52

#53

#534

#535

#536

#537

#538

#539

#54

#542

#543

#544

#549

#55

#55/merge

#550

#551

#552

#554

#555

#56

#565

#566

#567

#57

#572

#573

#574

#575

#576

#577

#578

#579

#58

#580

#581

#582

#583

#586

#589

#59

#590

#591

#592

#593

#594

#595

#597

#598

#599

#6

#6/merge

#60

#600

#601

#602

#603

#605

#606

#607

#608

#609

#61

#610

#611

#612

#614

#615

#616

#617

#618

#619

#62

#621

#622

#623

#624

#625

#626

#627

#628

#629

#63

#630

#631

#632

#638

#639

#64

#640

#642

#643

#644

#645

#646

#647

#648

#649

#65

#650

#651

#652

#653

#654

#655

#656

#657

#659

#66

#660

#661

#663

#664

#665

#667

#668

#669

#67

#670

#671

#672

#673

#674

#675

#676

#677

#678

#679

#68

#680

#681

#682

#683

#684

#685

#686

#69

#691

#692

#693

#694

#695

#696

#697

#7

#7/merge

#70

#700

#701

#703

#704

#705

#706

#707

#708

#709

#71

#710

#712

#713

#719

#72

#721

#722

#723

#725

#728

#73

#730

#731

#732

#733

#734

#735

#736

#737

#738

#739

#74

#740

#741

#742

#744

#745

#746

#75

#750

#751

#755

#756

#757

#758

#759

#76

#760

#761

#761/merge

#762

#763

#764

#765

#766

#767

#77

#770

#771

#772

#774

#775

#776

#777

#778

#779

#78

#780

#781

#781/merge

#782

#783

#784

#785

#786

#787

#788

#79

#8

#8/merge

#80

#81

#82

#83

#84

#85

#85/merge

#86

#87

#88

#89

#9

#9/merge

#90

#91

#92

#93

#94

#95

#96

#97

#98

#98/merge

#99

3.0.0

3.1.1

3.10.0

3.10.1

3.10.2

3.11.0

3.12.0

3.13.0

3.14.0

3.14.1

3.15.0

3.16.0

3.17.0

3.17.1

3.18.0

3.2.0

3.4.0-20190205

3.4.0-20190207

3.4.0-20190418

3.4.0-20200304

3.4.0-20200518

3.4.0-20210527

3.4.0-20210617

3.4.0-20210618

3.4.0-20210621

3.4.0-20210803

3.4.0-20210923

3.4.0-20220727

3.4.0-20240909

3.5.0

3.6.0

3.7.0

3.8.0

3.9.0

Mono Color

• 4688d8cda2 Bump commons-codec from 1.17.2 to 1.18.0 Alex Osborne 2025-03-31 14:52:42 +09:00
• 5ecfa7248c Bump jsch from 0.2.22 to 0.2.24 Alex Osborne 2025-03-31 14:52:25 +09:00
• 77b92c9da8 Bump groovy from 4.0.24 to 4.0.26 Alex Osborne 2025-03-31 14:52:00 +09:00
• e9227e7f84 Bump pdfbox from 3.0.3 to 3.0.4 Alex Osborne 2025-03-31 14:51:40 +09:00
• a56bec5e82 Bump slf4j from 2.0.16 to 2.0.17 Alex Osborne 2025-03-31 14:51:05 +09:00
• 78edc0a0c3 Bump amqp-client from 5.24.0 to 5.25.0 Alex Osborne 2025-03-31 14:47:57 +09:00
• 101070c2be Bump gson from 2.11.0 to 2.12.1 Alex Osborne 2025-03-31 14:47:29 +09:00
• 3f323bb0da Remove pillow from docs requirements.txt Alex Osborne 2025-03-21 13:23:03 +09:00
• a7c2f826b9 Update CI tests from JDK 23 to 24 Alex Osborne 2025-03-21 13:18:21 +09:00
• ace2ab80e8 Merge pull request #644 from adam-miller/adam/parameterize-yt-dlp-process-command Alex Osborne 2025-03-18 11:39:53 +09:00
• 710662fcd0 fix: Copy process arguments to mutable list to append url. Adam Miller 2025-03-17 14:38:59 -07:00
• 82bde56dc0 Merge branch 'master' into adam/parameterize-yt-dlp-process-command Adam Miller 2025-03-17 09:34:23 -07:00
• cc1a668abd Merge pull request #643 from adam-miller/adam/fix-optional-bdb-test-exception Alex Osborne 2025-03-15 09:42:21 +09:00
• 363f90b443 feat: Add a parameter to override default yt-dlp process arguments Adam Miller 2025-03-14 17:23:29 -07:00
• b02590cca0 Use AtomicInteger serializer rather than change accessibility Adam Miller 2025-03-14 09:14:26 -07:00
• 829c283ab2 fix: ObjectIdentityBdbManualCacheTest.java fails with -DrunSlowTests=true on Java 9+ Adam Miller 2025-03-13 16:00:39 -07:00
• 86473021d9 Update GitHub actions to use actions/cache@v4 Alex Osborne 2025-03-12 00:03:48 +09:00
• 22f8f7f754 Restore accidentally removed word Alex Osborne 2025-02-14 11:29:22 +09:00
• 88854d8dfd Add caption to deciderule extlinks Alex Osborne 2025-02-14 11:23:02 +09:00
• 71c2fdb618 Add missing readthedocs dependencies Alex Osborne 2025-02-14 11:15:35 +09:00
• ac33072991 Add build section .readthedocs.yml Alex Osborne 2025-02-14 11:12:32 +09:00
• 657eb582c6 Add .readthedocs.yml Alex Osborne 2025-02-14 11:10:09 +09:00
• d21a053c6d [maven-release-plugin] prepare for next development iteration Alex Osborne 2025-02-03 14:11:22 +09:00
• 370f0480e5 [maven-release-plugin] prepare release 3.7.0 3.7.0 Alex Osborne 2025-02-03 14:11:18 +09:00
• 8cf3e476d1 Bump ftpserver-core from 1.2.0 to 1.2.1 Alex Osborne 2025-02-03 14:08:51 +09:00
• ed02038e8b Update CHANGELOG for 3.7.0 Alex Osborne 2025-02-03 14:05:19 +09:00
• 48ac7484f0 Merge pull request #639 from internetarchive/update-deps-for-3.7 Alex Osborne 2025-02-03 12:02:16 +09:00
• 42e4151bc6 Merge pull request #640 from internetarchive/suppress-cookie-rejected-logging Alex Osborne 2025-02-03 12:01:55 +09:00
• cd3f3f9e09 Suppress 'WARNING Cookie rejected' messages in job.log Alex Osborne 2025-01-23 22:12:14 +09:00
• 3c5074da39 Bump spring from 6.1.15 to 6.1.16 Alex Osborne 2025-01-15 10:32:35 +09:00
• c54684279f Bump commons-codec from 1.17.1 to 1.17.2 Alex Osborne 2025-01-15 10:28:55 +09:00
• c8cedef792 Bump jsch from 0.2.21 to 0.2.22 Alex Osborne 2025-01-15 10:28:11 +09:00
• 9b0d4033dc Bump jetty from 9.4.56.v20240826 to 9.4.57.v20241219 Alex Osborne 2025-01-15 10:27:30 +09:00
• 1041fc67ed Bump freemarker from 2.3.33 to 2.3.34 Alex Osborne 2025-01-15 10:22:32 +09:00
• f844b968b9 Bump restlet from 2.5.0-rc1 to 2.5.0 Alex Osborne 2025-01-15 10:21:56 +09:00
• bd5927252e Bump amqp-client from 5.23.0 to 5.24.0 Alex Osborne 2025-01-15 10:21:22 +09:00
• a4c98e4d27 Merge pull request #638 from internetarchive/rel-nofollow Alex Osborne 2025-01-22 12:20:36 +09:00
• 4e8bda1a07 ExtractorHTML: Add obeyRelNofollow option Alex Osborne 2025-01-13 15:25:49 +09:00
• 4c4510a364 Merge pull request #632 from internetarchive/groovy-config Alex Osborne 2024-12-24 12:11:41 +09:00
• bfa8692d3b Bump webarchive-commons from 1.2.0 to 1.3.0 Alex Osborne 2024-12-20 14:47:03 +09:00
• d13acddfc4 Remove usages of fastutil Alex Osborne 2024-12-20 14:37:20 +09:00
• 19c24b9006 Add Groovy crawl configs Alex Osborne 2024-12-01 00:10:28 +09:00
• 2b2179d9c7 Update pom.xml for 3.6.1-SNAPSHOT Alex Osborne 2024-11-29 21:06:57 +09:00
• be81b3a407 Update maven release plugins for Java compat 3.6.0 Alex Osborne 2024-11-29 20:54:55 +09:00
• c67ff98b2d [maven-release-plugin] prepare for next development iteration Alex Osborne 2024-11-29 20:46:02 +09:00
• 2d903ae772 [maven-release-plugin] prepare release 3.6.0 Alex Osborne 2024-11-29 20:42:40 +09:00
• dd3616ea07 Update CHANGELOG for 3.6.0 release Alex Osborne 2024-11-29 20:28:11 +09:00
• 3fbf1bc8c0 Merge pull request #631 from internetarchive/update-deps Alex Osborne 2024-11-29 19:24:28 +09:00
• 1195bed1a1 Merge pull request #630 from internetarchive/remove-poi Alex Osborne 2024-11-29 19:16:54 +09:00
• a4a325436d Merge pull request #629 from internetarchive/restlet-2.5 Alex Osborne 2024-11-29 19:16:41 +09:00
• 6b1047385e Bump webarchive-commons from 1.1.10 to 1.2.0 Alex Osborne 2024-11-29 17:13:14 +09:00
• 0a215f6467 Bump jaxb-runtime from 2.3.1 to 4.0.5 Alex Osborne 2024-11-29 15:11:56 +09:00
• bd5fc39d9c Remove direct dependency on commons-logging Alex Osborne 2024-11-29 14:46:22 +09:00
• 1ef2a52a61 Bump easymock from 3.1 to 5.5.0 Alex Osborne 2024-11-29 14:16:30 +09:00
• d5b4391cce Bump java-socks-proxy-server from 1.1.0 to 4.1.2 Alex Osborne 2024-11-29 14:14:55 +09:00
• 9c799fdfad Remove unused java-websocket dependency Alex Osborne 2024-11-29 14:04:03 +09:00
• ea0b4611ca Bump kafka-clients from 3.8.0 to 3.9.0 Alex Osborne 2024-11-29 14:03:10 +09:00
• dceaa8517e Bump rabbitmq amqp-client from 5.18.0 to 5.23.0 Alex Osborne 2024-11-29 14:01:14 +09:00
• 6a498014f3 Bump gson from 2.8.9 to 2.11.0 Alex Osborne 2024-11-29 14:00:35 +09:00
• 6ff95c1bed Remove redundant commons-codec dependency declaration from contrib Alex Osborne 2024-11-29 13:59:04 +09:00
• 5778747527 Bump crawler-commons from 1.0 to 1.4 Alex Osborne 2024-11-29 13:54:27 +09:00
• ec7b03446c Bump commons-cli from 1.1 to 1.9.0 Alex Osborne 2024-11-29 13:50:04 +09:00
• add3ef58f7 Bump commons-io from 2.14.0 to 2.18.0 Alex Osborne 2024-11-29 13:48:02 +09:00
• faf26adbb5 Bump jsch from 0.1.54 (jcraft) to 0.2.21 (mwiede fork) Alex Osborne 2024-11-29 13:46:37 +09:00
• 9a4e3c37e8 Remove redundant pdfbox dependency declaration from heritrix-contrib Alex Osborne 2024-11-29 13:37:27 +09:00
• 4391f039a2 Bump httpcomponents from 4.5.13 to 4.5.14 Alex Osborne 2024-11-29 13:32:11 +09:00
• 3ac2cedc8e Bump junit from 4.13.1 to 4.13.2 Alex Osborne 2024-11-29 13:30:06 +09:00
• 631620c92b Bump groovy from 4.0.21 to 4.0.24 Alex Osborne 2024-11-29 11:47:39 +09:00
• fdab1d7e05 Bump dnsjava from 3.6.0 to 3.6.2 Alex Osborne 2024-11-29 11:43:23 +09:00
• d5fbb5ab89 Bump commons-codec from 1.6 to 1.17.1 Alex Osborne 2024-11-29 11:39:46 +09:00
• da67120347 Bump commons-net from 3.9.0 to 3.11.1 Alex Osborne 2024-11-29 11:37:24 +09:00
• 4fde0945e4 Bump kryo from 5.6.0 to 5.6.2 Alex Osborne 2024-11-29 11:34:49 +09:00
• a93761d0d5 Bump pdfbox from 3.0.1 to 3.0.3 Alex Osborne 2024-11-29 11:28:50 +09:00
• d11d38a56c Merge pull request #628 from internetarchive/slf4j-2.0.16 Alex Osborne 2024-11-29 11:24:12 +09:00
• d836fa7024 Merge pull request #627 from internetarchive/freemarker-2.3.33 Alex Osborne 2024-11-29 11:23:57 +09:00
• 2a0c4f2ae8 Move Apache POI to test scope Alex Osborne 2024-11-29 11:13:25 +09:00
• 7c04c0bc08 Remove maven.restlet.talend.com repository Alex Osborne 2024-11-29 10:35:05 +09:00
• 405b2efc6d Bump restlet from 2.4.0 to 2.5.0-rc1 Alex Osborne 2024-11-29 10:34:35 +09:00
• 533d762db5 Include slf4j-jdk14 in heritrix-engine as a compile dependency Alex Osborne 2024-11-28 20:49:22 +09:00
• b736bd6a24 Bump slf4j from 1.6.6 to 2.0.16 Alex Osborne 2024-11-28 20:38:30 +09:00
• e23254ffe2 Bump freemarker from 2.3.19 to 2.3.33 Alex Osborne 2024-11-28 20:17:00 +09:00
• 4093871de1 Merge pull request #626 from internetarchive/checkpoint-on-shutdown Alex Osborne 2024-11-28 16:43:45 +09:00
• 8ec614224e Merge pull request #625 from internetarchive/spring-6.1 Alex Osborne 2024-11-28 16:43:30 +09:00
• a02a339830 Fix StackOverflowError and map exceptions in Browse Beans Alex Osborne 2024-11-24 20:30:16 +09:00
• 6de204c53c AutoKryo: Replace SerializingInstantiatorStrategy with StdInstantiatorStrategy Alex Osborne 2024-11-24 19:51:56 +09:00
• dbed84740b Enable the -parameters compiler option Alex Osborne 2024-11-24 18:38:14 +09:00
• ec689dbce3 Document checkpointOnShutdown and --checkpoint options in the operating guide Alex Osborne 2024-11-24 14:05:03 +09:00
• 585fed8575 Add --checkpoint command-line option Alex Osborne 2024-11-24 13:28:12 +09:00
• 18c69def9a CheckpointService: Add checkpointOnShutdown option Alex Osborne 2024-11-24 13:08:11 +09:00
• 13075ec444 Merge pull request #624 from kris-sigur/strict-if-url-matching Alex Osborne 2024-11-20 17:12:08 +09:00
• 29cc045c22 Merge pull request #623 from kris-sigur/manfest-links Alex Osborne 2024-11-20 17:11:55 +09:00
• 205cd2a64b Bump spring.version from 5.3.39 to 6.1.15 Alex Osborne 2024-11-20 16:57:48 +09:00
• dd210c8e70 Replace Spring's removed @Required annotation with our own Alex Osborne 2024-11-20 16:30:15 +09:00
• 055f4f9f22 Require Java 17 minimum Alex Osborne 2024-11-20 15:31:36 +09:00
• 4a49557b8b Force strict if URL matching regex. Kristinn Sigurðsson 2024-10-30 08:53:08 +00:00
• 5ed6147c3e Treat manifest hops same as navlink hops Kristinn Sigurðsson 2024-10-29 08:53:15 +00:00
• 25c73da7e3 [maven-release-plugin] prepare for next development iteration Alex Osborne 2024-10-29 15:18:54 +09:00
• 0aec63b70f [maven-release-plugin] prepare release 3.5.0 3.5.0 Alex Osborne 2024-10-29 15:01:16 +09:00
• 24abe0c766 Update CHANGELOG for 3.5.0 Alex Osborne 2024-10-29 14:56:24 +09:00
• d42e8091a5 Remove repository.cloudera.com Alex Osborne 2024-10-25 17:04:43 +09:00