CDAP MAPR Installation Query

[Nirmalkumar S]

Hi Team,

I am planning to install CDAP6.1.4 in MAPR6.0.0.
Any documents to install cdap6.1.4 In MAPR Cluster.

Regards

Nirmal Kumar S

[Albert Shau]

Hi Nirmal,

Support for MapR was dropped a while ago. In particular, support for MapR 6 was never added because it replaced HBase with MapR DB.

Regards,

Albert

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/22637993-5beb-4e90-aa17-b21772b1f49an%40googlegroups.com.

[Nirmalkumar S]

Thanks, Albert.

I would like to understand if CDAP installation 6+ supports the native installation of Hadoop, HBase, Hive, Spark & Yarn. I have installed a single node native installation for the Hadoop ecosystem and am trying to install CDAP, but I am facing issues with few jars.

Below is an example of the java exception
1)Caused by: java.lang.UnsatisfiedLinkError: org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z

2)java.lang.RuntimeException: org.apache.hadoop.hbase.DoNotRetryIOException: org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.UnsatisfiedLinkError: org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()z

Please advise if this exercise will work out for me.

Regards

Nirmal Kumar S

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CAOtBAgiDCE8mTbxSePor4bDMyuXFTedZnSkh4UCPNsaLiKp-zg%40mail.gmail.com.

[Albert Shau]

Hi,

Yes it supports running on top of Hadoop, though not for all versions. Which version of Hadoop and HBase are you trying it with? More specifically, I think HBase versions over 1.3 are not supported.

Regards,

Albert

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CAO%2BimpqmHaA0z9za3zRzne00YTPTj1_P8TVyCeGuY8xEJ_GP-g%40mail.gmail.com.

[Nirmalkumar S]

Thanks, Albert.

I am trying Hadoop 2.6.0, hbase 1.0.0, hive 2.1.1, spark 2.1.1, and cdap 6.2.

Regards
Nirmal Kumar S

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CAOtBAghy1rg435qhghCt8eKhAcsyZzDoaiEXi79g8RiVA2Jiww%40mail.gmail.com.

[Nirmalkumar S]

Thanks, Albert.

I have configured and started cdap services..  I am getting issue in master service 

Please give me a suggestion for the service.

Log:

2021-03-24 19:51:25,821 INFO  [Kafka-Consumer-log-0] consumer.SimpleConsumer: Reconnect due to socket error: java.nio.channels.ClosedChannelException
2021-03-24 19:51:26,054 INFO  [Kafka-Consumer-log-0] consumer.SimpleConsumer: Reconnect due to socket error: java.nio.channels.ClosedChannelException
2021-03-24 19:51:29,021 INFO  [Kafka-Consumer-log-0] consumer.SimpleConsumer: Reconnect due to socket error: java.nio.channels.ClosedChannelException
2021-03-24 19:51:34,325 - ERROR [ProvisioningService STARTING:o.a.t.d.TransactionServiceClient@255] - Thrift error for org.apache.tephra.distributed.TransactionServiceClient$2@45485b69: Unable to discover transaction service.
2021-03-24 19:51:34,326 - WARN  [ProvisioningService STARTING:i.c.c.c.s.Retries@203] - Call failed with exception, retrying again after 6000 ms.
java.lang.RuntimeException: org.apache.thrift.TException: Unable to discover transaction service.
        at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[com.google.guava.guava-13.0.1.jar:na]
        at org.apache.tephra.distributed.TransactionServiceClient.startShort(TransactionServiceClient.java:297) ~[org.apache.tephra.tephra-core-0.15.0-incubating.jar:0.15.0-incubating]
        at org.apache.tephra.TransactionContext.start(TransactionContext.java:91) ~[org.apache.tephra.tephra-core-0.15.0-incubating.jar:0.15.0-incubating]
        at io.cdap.cdap.spi.data.nosql.dataset.NoSQLTransactionals$1.execute(NoSQLTransactionals.java:49) ~[na:na]
        at io.cdap.cdap.data2.transaction.Transactions$2.executeInternal(Transactions.java:261) ~[na:na]
        at io.cdap.cdap.data2.transaction.Transactions$2.execute(Transactions.java:248) ~[na:na]
        at io.cdap.cdap.spi.data.nosql.NoSqlTransactionRunner.run(NoSqlTransactionRunner.java:68) ~[na:na]
        at io.cdap.cdap.spi.data.transaction.TransactionRunners.run(TransactionRunners.java:165) ~[na:na]
        at io.cdap.cdap.internal.provision.ProvisionerStore.listTaskInfo(ProvisionerStore.java:52) ~[na:na]
        at io.cdap.cdap.common.service.Retries.callWithRetries(Retries.java:183) ~[na:na]
        at io.cdap.cdap.internal.provision.ProvisioningService.getInProgressTasks(ProvisioningService.java:658) [na:na]
        at io.cdap.cdap.internal.provision.ProvisioningService.resumeTasks(ProvisioningService.java:227) [na:na]
        at io.cdap.cdap.internal.provision.ProvisioningService.startUp(ProvisioningService.java:157) [na:na]
        at com.google.common.util.concurrent.AbstractIdleService$1$1.run(AbstractIdleService.java:43) [com.google.guava.guava-13.0.1.jar:na]
        at java.lang.Thread.run(Thread.java:748) [na:1.8.0_282]
Caused by: org.apache.thrift.TException: Unable to discover transaction service.
        at org.apache.tephra.distributed.AbstractClientProvider.newClient(AbstractClientProvider.java:106) ~[org.apache.tephra.tephra-core-0.15.0-incubating.jar:0.15.0-incubating]
        at org.apache.tephra.distributed.AbstractClientProvider.newClient(AbstractClientProvider.java:86) ~[org.apache.tephra.tephra-core-0.15.0-incubating.jar:0.15.0-incubating]
        at org.apache.tephra.distributed.PooledClientProvider$TxClientPool.create(PooledClientProvider.java:47) ~[org.apache.tephra.tephra-core-0.15.0-incubating.jar:0.15.0-incubating]
        at org.apache.tephra.distributed.PooledClientProvider$TxClientPool.create(PooledClientProvider.java:40) ~[org.apache.tephra.tephra-core-0.15.0-incubating.jar:0.15.0-incubating]
        at org.apache.tephra.distributed.ElasticPool.getOrCreate(ElasticPool.java:138) ~[org.apache.tephra.tephra-core-0.15.0-incubating.jar:0.15.0-incubating]
        at org.apache.tephra.distributed.ElasticPool.obtain(ElasticPool.java:125) ~[org.apache.tephra.tephra-core-0.15.0-incubating.jar:0.15.0-incubating]
        at org.apache.tephra.distributed.PooledClientProvider.getCloseableClient(PooledClientProvider.java:98) ~[org.apache.tephra.tephra-core-0.15.0-incubating.jar:0.15.0-incubating]
        at org.apache.tephra.distributed.TransactionServiceClient.execute(TransactionServiceClient.java:244) ~[org.apache.tephra.tephra-core-0.15.0-incubating.jar:0.15.0-incubating]
        at org.apache.tephra.distributed.TransactionServiceClient.execute(TransactionServiceClient.java:215) ~[org.apache.tephra.tephra-core-0.15.0-incubating.jar:0.15.0-incubating]
        at org.apache.tephra.distributed.TransactionServiceClient.startShort(TransactionServiceClient.java:288) ~[org.apache.tephra.tephra-core-0.15.0-incubating.jar:0.15.0-incubating]
        ... 13 common frames omitted
2021-03-24 19:51:34,327 - ERROR [bootstrap-service:o.a.t.d.TransactionServiceClient@255] - Thrift error for org.apache.tephra.distributed.TransactionServiceClient$2@11e9f226: Unable to discover transaction service.








Regards 
Nirmal Kumar S

[Albert Shau]

This means the transaction service is not running or can't be discovered for some reason. The transaction service is one of several system services that CDAP runs in YARN. In the YARN resource manager UI, do see a cdap.master application running with a bunch of containers (~8 or so)? If not, the service was not able to start up, potentially because the cluster is too small. If it is running, it could be that CDAP is not configured with the right Zookeeper quorum. Check your cdap-site.xml and make sure there is a zookeeper.quorum property that is correctly set to the Zookeeper hosts and ports for your cluster.

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CAO%2BimppBE7UsWafZqOpFhxYebrNf%3DbtKLw2-6EudehF8gBzjEw%40mail.gmail.com.