Commit Graph

Select branches

Hide Pull Requests

ARI-5439

adam/add-crawl-log-logging-to-extractoryoutubedl

adam/add_configurable_extractor_js_script_attribute_rules

adam/ait-add-crawl-log-logging-to-extractoryoutubedl

adam/fix_configurable_js_extractor_strict_overlay

adam/fix_crawl_end_time_checkpoint_resumption

adam/knowledgable_extractorjs_extends_configurable_extractorjs

adam/restore-has-prerequisite-behavior

adam/strip_invalid_xml_chars_from_rest_api_output

adds-bdbmodule-max-file-size-option

adds-subqueue-support-forced-queue-assignment

adds-trough-dedup-performance-rework

adds-trough-local-dedup-write-cache

ait-qa

ait-ydl-updates

ato/BrowserProcessor-fixes

browser-processor-reliability

collectd-socket-stats-writer

fix-yt-dlp-typo-too

fixes-WARCWriterChainProcessor-checkpoint-stats

fixes-extractor-multiple-regex-matcher-recycle

fixes-leaky-file-handles

fixes-prerequisite-status

fixes-trough-client-synchronization

fixes-trough-crawl-log-feed-synchronization

less_youtubedl

master

master-ait-contrib

master-it

meta-content-name

noplaylist-ydl

restlet_npe

revert-367-fixes-trough-crawl-log-feed-synchronization

ydl-no-cache

yt-dl-format

yt-dl-format-medium-ish

yt-dlp

yt-dlp-20230706

yt-dlp-4-h3

yt-dlp-for-h3

#1

#1

#10

#10

#100

#101

#102

#103

#104

#105

#106

#107

#108

#109

#11

#11

#110

#111

#112

#113

#114

#115

#116

#117

#118

#119

#12

#12

#120

#121

#122

#123

#124

#125

#126

#127

#127

#128

#129

#13

#13

#130

#131

#132

#133

#134

#134

#135

#136

#137

#138

#139

#14

#14

#140

#140

#141

#142

#143

#144

#145

#146

#147

#148

#149

#15

#15

#150

#151

#152

#153

#153

#154

#159

#16

#16

#161

#163

#164

#165

#166

#168

#169

#17

#17

#171

#174

#174

#178

#179

#18

#180

#183

#183

#184

#184

#185

#186

#187

#188

#188

#189

#19

#19

#190

#192

#194

#196

#197

#2

#2

#20

#20

#205

#207

#209

#21

#21

#210

#213

#215

#216

#217

#218

#219

#22

#22

#220

#222

#223

#224

#226

#227

#23

#230

#231

#235

#238

#24

#240

#241

#242

#243

#244

#246

#248

#249

#25

#251

#253

#255

#256

#257

#26

#260

#262

#269

#27

#270

#271

#272

#273

#276

#28

#280

#281

#283

#285

#286

#287

#288

#289

#29

#290

#292

#292

#294

#295

#296

#298

#3

#3

#30

#300

#301

#302

#303

#304

#306

#308

#31

#310

#312

#313

#314

#315

#317

#32

#320

#323

#325

#326

#327

#328

#329

#33

#330

#331

#333

#334

#335

#336

#34

#341

#342

#345

#346

#347

#348

#349

#35

#352

#354

#355

#356

#357

#359

#36

#362

#364

#365

#366

#367

#368

#369

#37

#370

#373

#374

#375

#377

#379

#38

#381

#382

#383

#384

#385

#386

#388

#388

#389

#39

#390

#391

#393

#394

#395

#397

#398

#399

#4

#4

#40

#400

#401

#402

#403

#404

#405

#406

#407

#408

#409

#41

#410

#411

#412

#414

#415

#416

#418

#42

#421

#423

#424

#43

#431

#433

#434

#435

#44

#441

#442

#444

#445

#448

#45

#450

#452

#454

#456

#457

#459

#46

#460

#461

#465

#468

#47

#470

#475

#476

#478

#48

#480

#483

#484

#486

#488

#489

#49

#490

#491

#492

#493

#5

#5

#50

#503

#51

#52

#53

#534

#535

#536

#537

#538

#539

#54

#542

#543

#544

#549

#55

#55

#550

#551

#552

#554

#555

#56

#565

#566

#567

#57

#572

#573

#574

#575

#576

#577

#578

#579

#58

#580

#581

#582

#583

#586

#589

#59

#590

#591

#592

#593

#594

#595

#597

#598

#599

#6

#6

#60

#600

#601

#602

#603

#605

#606

#607

#608

#609

#61

#610

#611

#612

#614

#615

#616

#617

#618

#619

#62

#621

#622

#623

#624

#625

#626

#627

#628

#629

#63

#630

#631

#632

#638

#639

#64

#640

#642

#643

#644

#645

#646

#647

#648

#649

#65

#650

#651

#652

#653

#654

#655

#656

#657

#659

#66

#660

#661

#663

#664

#665

#667

#668

#669

#67

#670

#671

#672

#673

#674

#675

#676

#677

#678

#679

#68

#680

#681

#682

#683

#684

#685

#686

#69

#691

#692

#693

#694

#695

#696

#697

#7

#7

#70

#700

#701

#703

#704

#705

#706

#707

#708

#709

#71

#710

#712

#713

#719

#72

#721

#722

#723

#725

#728

#73

#730

#731

#732

#733

#734

#735

#736

#737

#738

#739

#74

#740

#741

#742

#744

#745

#746

#75

#750

#751

#76

#77

#78

#79

#8

#8

#80

#81

#82

#83

#84

#85

#85

#86

#87

#88

#89

#9

#9

#90

#91

#92

#93

#94

#95

#96

#97

#98

#98

#99

3.0.0

3.1.1

3.10.0

3.10.1

3.10.2

3.11.0

3.12.0

3.13.0

3.14.0

3.14.1

3.15.0

3.16.0

3.2.0

3.4.0-20190205

3.4.0-20190207

3.4.0-20190418

3.4.0-20200304

3.4.0-20200518

3.4.0-20210527

3.4.0-20210617

3.4.0-20210618

3.4.0-20210621

3.4.0-20210803

3.4.0-20210923

3.4.0-20220727

3.4.0-20240909

3.5.0

3.6.0

3.7.0

3.8.0

3.9.0

Mono Color

• 66535370ff Merge pull request #312 from internetarchive/guava-dep Alex OsborneandGitHub 2020-02-28 10:16:55 +09:00
• 009458f2db Merge branch 'master-ait-contrib' into ait-qa Neil Minton 2020-02-13 15:40:58 -05:00
• 97545664b2 Remove Kafka support. Neil Minton 2020-02-13 15:38:38 -05:00
• f5a49e70b2 Remove Hbase support. Neil Minton 2020-02-13 15:38:21 -05:00
• 6fcc5e808a Exclude hbase-client's guava 12 transitive dependency Alex Osborne 2020-02-13 16:59:13 +09:00
• bc6a15b41d Use HTTPS to resolve dependencies in Maven Build where possible Jonathan LeitschuhandAlex Osborne 2020-02-11 17:43:34 +09:00
• 015c5e7f80 Merge pull request #308 from ldko/fix-restlet-errors Alex OsborneandGitHub 2020-01-31 09:33:26 +09:00
• 8c1c8009c6 Fix stream closed exception for Paged view Lauren Ko 2020-01-30 16:48:38 -06:00
• b45f774066 Merge pull request #300 from hennekey/fix-299 Alex OsborneandGitHub 2020-01-30 19:12:05 +09:00
• fd9136dbfa Merge pull request #304 from hennekey/remove-custom-base32 Alex OsborneandGitHub 2020-01-30 19:07:09 +09:00
• 54e05a7864 Correct encoding Tim Hennekey 2020-01-28 15:12:54 -05:00
• 3528c990df Merge pull request #303 from hennekey/refactor-history Alex OsborneandGitHub 2020-01-28 14:49:00 +09:00
• 00fd8c2960 Merge pull request #306 from internetarchive/fix-stream-closed Alex OsborneandGitHub 2020-01-28 02:17:07 +09:00
• a4ce59dbd6 Fix stream closed exception by not closing output stream Alex Osborne 2020-01-25 08:25:59 +09:00
• b5f95c5e06 Replace custom Base32 encoding Tim Hennekey 2020-01-24 12:46:37 -05:00
• 3003a8e751 Replace constant with accessor methods Tim Hennekey 2020-01-24 12:28:11 -05:00
• 9927e1325f Merge pull request #296 from hennekey/update-junit Alex OsborneandGitHub 2020-01-23 16:44:59 +09:00
• 8ffcfa9020 Merge pull request #302 from nlevitt/ydl-streaming Barbara MillerandGitHub 2020-01-22 15:08:26 -08:00
• dbade18b58 Merge pull request #301 from nlevitt/fix-logging-config Barbara MillerandGitHub 2020-01-22 14:42:22 -08:00
• 9cb9563da3 Increment the count only when the filter notes it Tim Hennekey 2020-01-22 17:15:24 -05:00
• 33458f1518 Fix assertions Tim Hennekey 2020-01-22 17:13:58 -05:00
• 6f69dd73d6 Merge branch 'ydl-streaming' into ait-qa Noah Levitt 2020-01-22 14:13:22 -08:00
• 6667186826 java 8 compatibility Noah Levitt 2020-01-22 14:12:36 -08:00
• b4cf06d087 Merge branch 'ydl-streaming' into ait-qa Noah Levitt 2020-01-22 14:03:20 -08:00
• 515bcca6d6 Merge branch 'fix-logging-config' into ait-qa Noah Levitt 2020-01-22 14:03:09 -08:00
• 9229a51dcb limit ExtractorYoutubeDL heap usage Noah Levitt 2020-01-22 13:49:24 -08:00
• 784b3a5dec fix logging config Noah Levitt 2020-01-22 13:39:24 -08:00
• 66723aea68 Remove version Tim Hennekey 2020-01-21 10:52:15 -05:00
• a8c41aa014 Merge pull request #298 from hennekey/fix-297 Alex OsborneandGitHub 2020-01-16 15:42:06 +09:00
• 080380b18a Use Guice instead of custom implementation Tim Hennekey 2020-01-15 18:13:20 -05:00
• 739cf7fdb3 Merge pull request #287 from nlevitt/trough-dedup-fix jkafaderandGitHub 2020-01-15 11:21:06 -08:00
• 00a1f2c9b0 Merge pull request #294 from internetarchive/fix-config-post Noah LevittandGitHub 2020-01-15 11:01:00 -08:00
• ccbf678f4a Merge pull request #295 from internetarchive/disable-wbm-test Noah LevittandGitHub 2020-01-15 10:56:31 -08:00
• 0fa87a36e8 Add default constructor to IdentityCacheWrapper Tim Hennekey 2020-01-15 13:35:45 -05:00
• 55308ba90a Move IdentityCacheableWrapper Tim Hennekey 2020-01-15 13:29:32 -05:00
• 0fe8463e81 Remove AtomicInteger loop counter Tim Hennekey 2020-01-15 13:04:09 -05:00
• 611fa325df Remove unused code Tim Hennekey 2020-01-15 12:56:10 -05:00
• bb61aa0bcb Fix unchecked warning Tim Hennekey 2020-01-15 12:09:24 -05:00
• 4be3e620c3 Set JUnit version to latest Tim Hennekey 2020-01-15 11:08:31 -05:00
• 615578b22d Add IntelliJ IDEA and Heritrix runtime files to .gitignore Alex Osborne 2020-01-15 18:19:25 +09:00
• dcdaba3b10 Disable test that connects to wwwb-dedup.us.archive.org Alex Osborne 2020-01-15 17:48:31 +09:00
• 34be934da5 Fix 'Method Not Allowed' on POST of config editor form Alex Osborne 2020-01-15 16:51:19 +09:00
• 8e875bb17f Merge pull request #288 from netarchivesuite/inline-image-filter Alex OsborneandGitHub 2020-01-15 12:48:54 +09:00
• 3a8b58998c Merge pull request #285 from nlevitt/warc-writer-chain jkafaderandGitHub 2020-01-13 16:39:42 -08:00
• 31b9960503 basic level of documentation Noah Levitt 2019-12-30 16:02:10 -08:00
• 808ff9a5b7 Merge branch 'trough-dedup-fix' into ait-qa Noah Levitt 2019-11-19 14:35:30 -08:00
• 125547b93d change trough dedup date type to varchar. Noah Levitt 2019-11-19 14:34:49 -08:00
• 204491c357 Attempt to filter out embedded images. Colin Rosenthal 2018-10-12 14:24:05 +02:00
• 14e1eee662 Merge branch 'warc-writer-chain' into ait-qa Noah Levitt 2019-11-18 14:43:58 -08:00
• ff8ebc4c2e use JSONObject.isNull() Noah Levitt 2019-11-18 14:42:38 -08:00
• 35c65ccb5a Merge remote-tracking branch 'origin/master' into ait-qa Noah Levitt 2019-11-15 16:21:39 -08:00
• 7c76dfba7c Merge branch 'warc-writer-chain' into ait-qa Noah Levitt 2019-11-15 16:14:51 -08:00
• 6e7bc54c9d use org.json like everybody else Noah Levitt 2019-11-15 16:14:17 -08:00
• 4524f24dc7 Merge branch 'warc-writer-chain' into ait-qa Noah Levitt 2019-11-15 15:54:31 -08:00
• c4b08166f2 extract watch page links from youtube playlists Noah Levitt 2019-11-15 15:52:36 -08:00
• 4983e65929 fix non-playlist case (oops!) Noah Levitt 2019-11-15 15:42:59 -08:00
• 5e536862db Removed mistaken additions Colin Rosenthal 2019-11-15 14:38:45 +01:00
• bf5842c02e removed .iml file Colin Rosenthal 2019-11-15 14:37:11 +01:00
• f76ec2f362 Merge remote-tracking branch 'origin/crawltrap-regex-timeout' into crawltrap-regex-timeout Colin Rosenthal 2019-11-15 14:34:11 +01:00
• 718cc5ae32 Updated manually to new SNAPSHOT version Colin Rosenthal 2019-11-15 14:34:03 +01:00
• f22a97875d Added a timeout to crawlertrap regex matching Colin Rosenthal 2019-11-15 14:31:40 +01:00
• c611c46c8a Merged frontier-management with upgrade to bdb 7 Nicholas ClarkeandColin Rosenthal 2017-11-21 13:44:54 +01:00
• 73db3ac628 Merge branch 'master' into upgrade-bdb-je Andrew Jackson 2019-10-17 14:10:22 +01:00
• 1b95453748 be consistent and null-safe with concurrentTo Noah Levitt 2019-10-15 10:50:26 -07:00
• 7a83aecb28 Merge pull request #286 from internetarchive/adds-subqueue-support-forced-queue-assignment Noah LevittandGitHub 2019-10-11 13:52:47 -07:00
• 74c0739bb0 fix line ending and indentation issues adds-subqueue-support-forced-queue-assignment Noah Levitt 2019-10-11 13:49:49 -07:00
• 0cee24922f AssignmentLevelSurtQueueAssignmentPolicy.java - Add support for forced queue assignment and parallel queues URIAuthorityBasedQueueAssignmentPolicy.java - Add interoperability between forced queue assignment and parallel queues QuotaEnforcer.java - Fix javadoc to match default behavior Adam Miller 2019-10-11 19:44:35 +00:00
• feea47b2c7 Merge pull request #283 from internetarchive/jobdir-put-fix Noah LevittandGitHub 2019-08-28 12:41:00 -07:00
• eeddfd763f Override PUT so it doesn't change the file extension Alex Osborne 2019-08-28 12:46:29 +09:00
• 5612fa249b Use super.getVariants() rather than super.getVariants(GET) Alex Osborne 2019-08-27 23:53:34 +09:00
• 2eafb5a0c4 Merge pull request #280 from internetarchive/fix-cookie-test-failures Noah LevittandGitHub 2019-08-16 10:08:31 -07:00
• 2a5bd87e51 Remove testConcurrentLoad Alex Osborne 2019-08-16 22:11:26 +09:00
• f63570f977 Merge branch 'master' into upgrade-bdb-je Andrew Jackson 2019-08-12 16:21:29 +01:00
• a5c03d9b73 Mitigate random CookieStore.testConcurrentLoad test failures Alex Osborne 2019-08-12 18:08:43 +09:00
• 38c44e8e8e Add missing UUID import (interactive commit fail) Alex Osborne 2019-08-12 17:50:35 +09:00
• 36003b8626 Fix digest authentication Alex Osborne 2019-08-12 17:36:16 +09:00
• 92ffdede0d Link to javadoc.io for more recent api docs Alex OsborneandGitHub 2019-08-12 15:03:52 +09:00
• 7dab6ec275 Avoid using Thread.interrupt as this freaks BDB-JE. Andrew Jackson 2019-08-11 22:03:55 +01:00
• 45cd46e030 Try upping to BDB JE 7.5.11 Andrew Jackson 2019-08-11 12:42:03 +01:00
• 8b72be7d1d Now jdk11 support is merged we can disallow test failures on it Alex Osborne 2019-08-08 10:37:38 +09:00
• cefad96036 Merge pull request #276 from internetarchive/jdk11-upgrade-jetty Noah LevittandGitHub 2019-08-07 10:48:51 -07:00
• a1f2c9513a Merge pull request #273 from internetarchive/jdk11-remove-old-bdbcache Noah LevittandGitHub 2019-08-07 10:48:40 -07:00
• 6811f49bd9 Merge pull request #272 from internetarchive/jdk11-upgrade-surefire Noah LevittandGitHub 2019-08-07 10:48:29 -07:00
• ebb0d3fd48 Merge pull request #271 from internetarchive/jdk11-toolsjar Noah LevittandGitHub 2019-08-07 10:48:19 -07:00
• d5956d1443 Merge pull request #269 from internetarchive/jdk11-jaxb Noah LevittandGitHub 2019-08-07 10:48:02 -07:00
• 97b9c3c91c Fix restlet child component context warning Alex Osborne 2019-08-06 17:13:29 +09:00
• 6c2afc36b0 Update statistics assertions as Jetty 9 produces different headers Alex Osborne 2019-08-06 17:03:58 +09:00
• 4012a5f4dd Fix 'No session data store configured' test error Alex Osborne 2019-08-06 16:56:10 +09:00
• 996d1366b0 Drop support for JDK 7 Alex Osborne 2019-08-06 16:41:09 +09:00
• 0782fb0481 JDK11: upgrade engine to jetty 9.4.19 and restlet 2.4.0 Alex Osborne 2019-08-06 15:10:48 +09:00
• 9d1341c731 JDK11 support: upgrade jetty to 9.4.19 in modules tests Alex Osborne 2019-08-05 12:57:31 +09:00
• fea6a9c60c Merge pull request #256 from ruebot/readme-updates Alex OsborneandGitHub 2019-08-05 13:15:19 +09:00
• d3d19e2248 Prevent newer surefire from invoking FetchHTTPTests directly Alex Osborne 2019-08-02 17:57:09 +09:00
• a5c2b46208 JDK11 support: remove unused class ObjectIdentityBdbCache and tests Alex Osborne 2019-08-02 17:10:13 +09:00
• bf819e19a5 JDK11 support: exclude tools.jar from hbase-client dependency Alex Osborne 2019-08-02 13:44:49 +09:00
• a2920c622d JDK11 support: explicitly depend on JAXB Alex Osborne 2019-08-02 13:02:54 +09:00
• 412885fd7d JDK11 support: upgrade maven-surefire-plugin to 2.22.2 Alex Osborne 2019-08-02 16:43:20 +09:00
• 7a1c4f5334 Merge pull request #270 from internetarchive/travis-fixes Alex OsborneandGitHub 2019-08-02 16:08:12 +09:00
• 74a0222e56 Travis fixes Alex OsborneandGitHub 2019-08-02 15:47:02 +09:00
• 308cee85a3 Add sitemap extraction to default profile kristinn 2019-07-05 11:28:53 +00:00