My ClusterCfgMetadataAPIConfig.properties

18 views
Skip to first unread message

Alison Apel

unread,
Dec 28, 2015, 4:28:02 PM12/28/15
to kamanja, William Tarver
Hi,
      I am on step 2 of the Kamanja Cluster Installation (I'm looking at the test file in my Kamanja/ClusterInstall directory. Here's what my ClusterCfgMetadataAPIConfig.properties file looks like.

NODEID={NodeId}

MetadataDataStore={"StoreType": "hbase","SchemaName": "kamanja","Location": "localhost", "authentication":"kerberos","regionserver_principal":"hbase/_HO...@INTRANET.LIGADATA.COM","master_principal":"hbase/_HO...@INTRANET.LIGADATA.COM","principal":"liga...@INTRANET.LIGADATA.COM","keytab":"/Users/alisonapel/Downloads/Kamanja/config/ligadata.keytab"}

ROOT_DIR=/Users/alisonapel/Downloads/Kamanja

GIT_ROOT=/Users/alisonapel/Downloads/Kamanja

JAR_TARGET_DIR=/Users/alisonapel/Downloads/Kamanja/lib/application

SCALA_HOME=/Users/alisonapel/Downloads/scala-2.10.4

JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1.8_65.jdk/Contents/Home

MANIFEST_PATH=/Users/alisonapel/Downloads/Kamanja/config/manifest.mf

CLASSPATH=/Users/alisonapel/Downloads/Kamanja/lib/system/metadata_2.10-1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/basefunctions_2.10-0.1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/messagedef_2.10-1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/methodextractor_2.10-1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/pmmlcompiler_2.10-1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/kamanjabase_2.10-1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/kvbase_2.10-0.1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/bootstrap_2.10-1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/joda-time-2.8.2.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/joda-convert-1.6.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/basetypes_2.10-0.1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/pmmludfs_2.10-1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/pmmlruntime_2.10-1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/json4s-native_2.10-3.2.9.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/json4s-core_2.10-3.2.9.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/json4s-ast_2.10-3.2.9.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/jackson-databind-2.3.1.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/jackson-annotations-2.3.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/json4s-jackson_2.10-3.2.9.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/jackson-core-2.3.1.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/log4j-core-2.4.1.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/log4j-api-2.4.1.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/guava-16.0.1.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/exceptions_2.10-1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/scala-reflect-2.10.4.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/scala-library-2.10.4.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/jsr305-1.3.9.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/datadelimiters_2.10-1.0.jar

NOTIFY_ENGINE=YES

ZNODE_PATH=/kamanja

API_LEADER_SELECTION_ZK_NODE=/kamanja

ZOOKEEPER_CONNECT_STRING=localhost:2181

COMPILER_WORK_DIR=/Users/alisonapel/Downloads/Kamanja/workingdir

SERVICE_HOST={HostName}

SERVICE_PORT=8081

MODEL_FILES_DIR=/Users/alisonapel/Downloads/Kamanja/config

 COMPILER_WORK_DIR=/Users/alisonapel/Downloads/Kamanja/workingdir

SERVICE_HOST={HostName}

SERVICE_PORT=8081

MODEL_FILES_DIR=/Users/alisonapel/Downloads/Kamanja/config

TYPE_FILES_DIR=/Users/alisonapel/Downloads/Kamanja/config

FUNCTION_FILES_DIR=/Users/alisonapel/Downloads/Kamanja/config

CONCEPT_FILES_DIR=/Users/alisonapel/Downloads/Kamanja/config

MESSAGE_FILES_DIR=/Users/alisonapel/Downloads/Kamanja/config

CONTAINER_FILES_DIR=/Users/alisonapel/Downloads/Kamanja/config

CONFIG_FILES_DIR=/Users/alisonapel/Downloads/Kamanja/config

MODEL_EXEC_LOG=false

JarPaths=/Users/alisonapel/Downloads/Kamanja/lib/system,/Users/alisonapel/Downloads/Kamanja/lib/application

SECURITY_IMPL_JAR=/Users/alisonapel/Downloads/Kamanja/lib/system/simpleapacheshiroadapter_2.10-1.0.jar

SECURITY_IMPL_CLASS=com.ligadata.Security.SimpleApacheShiroAdapter

AUDIT_IMPL_JAR=/Users/alisonapel/Downloads/Kamanja/lib/system/auditadapters_2.10-1.0.jar

AUDIT_IMPL_CLASS=com.ligadata.audit.adapters.AuditCassandraAdapter

DO_AUDIT=NO

DO_AUTH=NO

SSL_CERTIFICATE=/Users/alisonapel/Downloads/Kamanja/config/keystore.jks

SSL_PASSWD=keystore


My questions are:


Substep 4 says: Replace proper metadata store information for the key MetadataDataStore. 


What should be the proper metadata store information? Also, what should NODEID be?


thanks,

alison


William Tarver

unread,
Dec 28, 2015, 4:34:26 PM12/28/15
to Alison Apel, kamanja

You don't need to set nodeid. Looking at your config, remove everything after location since you probably don't have kerb Eros setup.

Alison Apel

unread,
Dec 28, 2015, 5:00:16 PM12/28/15
to William Tarver, kamanja
Thanks William! more questions:

substep 5. Make sure we have valid information for SSL_CERTIFICATE & SSL_PASSWD if required.

question: What is that valid information?

substep 6: Make sure we have proper zookeeper information for keys ZOOKEEPER_CONNECT_STRING, ZNODE_PATH & API_LEADER_SELECTION_ZK_NODE

question: What are the proper key values for Zookeeper?

thanks,
alison

William Tarver

unread,
Dec 28, 2015, 5:05:53 PM12/28/15
to Alison Apel, kamanja
These are all items that are likely (or should be) covered in other parts of documentation.

SSL_CERTIFICATE and SSL_PASSWD are used for MetadataAPIService and should be with the REST API or security documentation.

SSL_CERTIFICATE is a bit of a bad name, it’s actually the fully qualified path to the keystore. For example /home/alison/keystore.jks. Creating this is described in the security section of documentation

SSL_PASSWD is the password set when creating the keystore.

ZOOKEEPER_CONNECT_STRING is exactly as it says. It’s the connect string for zookeeper. It follows the format “server:port”. i.e. 10.0.0.15:2181 or myZkServer:2181

ZNODE_PATH is the base node on which kamanja is storing information on zookeeper. We typically set this as /kamanja but can be whatever the user wants as long as it follow the format /<node>.

API_LEADER_SELECTION_ZK_NODE should be kept the same as ZNODE_PATH.

Donald

unread,
Feb 2, 2016, 11:33:22 AM2/2/16
to kamanja, wil...@ligadata.com


On Monday, December 28, 2015 at 1:28:02 PM UTC-8, alison wrote:
Hi,
      I am on step 2 of the Kamanja Cluster Installation (I'm looking at the test file in my Kamanja/ClusterInstall directory. Here's what my ClusterCfgMetadataAPIConfig.properties file looks like.

NODEID={NodeId}

MetadataDataStore={"StoreType": "hbase","SchemaName": "kamanja","Location": "localhost", "authentication":"kerberos","regionserver_principal":"hbase/_HO...@INTRANET.LIGADATA.COM","master_principal":"hbase/_HO...@INTRANET.LIGADATA.COM","principal":"ligadata@INTRANET.LIGADATA.COM","keytab":"/Users/alisonapel/Downloads/Kamanja/config/ligadata.keytab"}

Reply all
Reply to author
Forward
0 new messages