Alex Osborne
bf819e19a5
JDK11 support: exclude tools.jar from hbase-client dependency
...
tools.jar is no longer included in the JDK as of JDK 11 (per JEP 220) so
exclude it as a dependency. According to [HBASE-13963] it is only
required when compiling hbase itself and was unintentionally leaked
as a transitive dependency.
Fixes #265
[HBASE-13963]: https://issues.apache.org/jira/browse/HBASE-13963
2019-08-02 16:47:42 +09:00
Andrew Jackson
b3961a2f96
[maven-release-plugin] prepare for next development iteration
2019-04-18 15:36:28 +01:00
Andrew Jackson
c7c6141ee1
[maven-release-plugin] prepare release 3.4.0-20190418
2019-04-18 15:36:20 +01:00
Noah Levitt
1b89420f99
trough dedup!
2019-03-14 13:47:15 -07:00
Andrew Jackson
ad9e74d8ad
[maven-release-plugin] prepare for next development iteration
2019-02-07 13:52:56 +00:00
Andrew Jackson
83c7044b22
[maven-release-plugin] prepare release 3.4.0-20190207
2019-02-07 13:52:49 +00:00
Andrew Jackson
317b19e7e2
[maven-release-plugin] prepare for next development iteration
2019-02-05 12:33:08 +00:00
Andrew Jackson
9c7d0c299d
[maven-release-plugin] prepare release 3.4.0-20190205
2019-02-05 12:32:57 +00:00
Andrew Jackson
ab34a54566
[maven-release-plugin] prepare for next development iteration
2019-02-05 12:29:33 +00:00
Andrew Jackson
d1fc5cedb4
[maven-release-plugin] prepare release 3.4.0-20190205-2
2019-02-05 12:29:26 +00:00
Andrew Jackson
096ba4e9c3
[maven-release-plugin] prepare for next development iteration
2019-02-05 12:15:26 +00:00
Noah Levitt
8bda0d4cf0
use non-deprecated hbase api
...
Catch exceptions and attempt to reset the hbase connection. The intent
is for this to fix the problem where the hbase connection (under the
hood the problem is the zookeeper connection) gets into a borked state,
and we never reset it.
2018-11-09 15:28:17 -08:00
jkafader
4c438d3852
Merge pull request #180 from internetarchive/aitfive-1176
...
trough feed
2017-09-05 17:37:36 -07:00
Noah Levitt
3892c17b56
ughhh appease java 8 javadoc rules
2017-06-15 17:29:22 -07:00
Noah Levitt
66fabf790e
hacked up tarball with heritrix, contrib and dependencies
2017-06-07 18:05:52 -07:00
Noah Levitt
f665ce844f
upgrade to kafka 0.9
2016-02-08 12:49:47 -08:00
Noah Levitt
77e2a47c4c
AITFIVE-203 kafka crawl log feed
2014-11-05 12:59:10 -08:00
Noah Levitt
e5e5cd87e4
configure maven-compiler-plugin in root pom to avoid redundancy, inconsistency
2014-10-01 13:38:39 -07:00
Kenji Nagahashi
f343ce2ae1
suppress JUnit 4 dependency through hbase-client.
...
rewrite WbmPersistLoadProcessorTest for JUnit 3.
(also disable a test that depends on production CDX server)
2014-08-26 10:56:35 -07:00
Kenji Nagahashi
bb511796ec
Update POMs for newly imported Wayback-dedup module.
...
lock httpclient version to 4.3.3 stated by
heritrix-commons. have to exclude hadoop’s
dependency on jets3t 0.9.0 as it pulls in httpcore 4.1.2.
add easy mock 3.1 to heritrix-contrib.
2014-08-25 16:44:48 -07:00
Noah Levitt
3e35c967ab
upgrade hbase to cdh5
2014-06-16 18:33:25 -07:00
Adam Miller
a48a29f9bd
Adding ExtractorPDFContent to find nav links from the text content of PDFs
2014-04-14 16:02:35 -07:00
Eldon
d3e96b2770
First pass at a processor to publish crawluris to AMQP channels
2014-01-24 18:11:47 -08:00
Noah Levitt
749bd6a214
bump version to 3.3.0-SNAPSHOT after 3.2.0 release
2014-01-10 16:22:43 -08:00
Noah Levitt
32c083f720
bump version number to 3.2.0 for release
2014-01-10 12:36:45 -08:00
Noah Levitt
0ea10665f1
abbreviate maven repository clauses, reduce redundancy, and let default settings prevail, such as updatePolicy=daily, pointed out by Erik Hetzner
2013-12-15 11:53:18 -08:00
Noah Levitt
8e1125d062
bump version to 3.2.0-SNAPSHOT since there are some incompatible api changes since 3.1.1 (requested by kris sigurðsson)
2013-11-20 09:18:31 -08:00
Noah Levitt
57311db117
use libs version ${project.version}
2013-09-10 15:24:58 -07:00
Adam Miller
646133ce4e
pom.xml
...
Adding heritrix-engine dependency
XmlCrawlSummaryReport.java
XML version of the CrawlSummaryReport
ExtractorYoutubeFormatStream.java
Adding sample bean to docs
2013-06-12 16:43:28 -07:00
Noah Levitt
0508abb9ad
new contrib subproject for extra generally useful modules not part of the main distribution
2013-06-05 13:12:36 -07:00
Alex Osborne