Getting errors starting compute and master

[Alvin Hom]

I am getting the following error when I try to start the master and compute node for "historical" mode.  I have zookeeper running (single node).  I also had to modify the runtime.properties a little bit, as the one posted on the wiki seems to be missing some values.  Can someone post an updated version of runtime.properties.

Error from master:

2012-10-31 00:13:28,142 ERROR [main] com.metamx.druid.http.ServerMain - Error when starting up.  Failing.

java.lang.reflect.InvocationTargetException

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:597)

at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:108)

at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:54)

at com.metamx.druid.http.MasterMain.main(MasterMain.java:203)

Caused by: org.I0Itec.zkclient.exception.ZkNoNodeException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /druid/indexesPath

at org.I0Itec.zkclient.exception.ZkException.create(ZkException.java:47)

at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:685)

at org.I0Itec.zkclient.ZkClient.getChildren(ZkClient.java:413)

at org.I0Itec.zkclient.ZkClient.getChildren(ZkClient.java:409)

at com.metamx.druid.client.ZKPhoneBook$InternalPhoneBook.registerListener(ZKPhoneBook.java:315)

at com.metamx.phonebook.BasePhoneBook.registerListener(BasePhoneBook.java:176)

at com.metamx.druid.client.InventoryManager.start(InventoryManager.java:102)

at com.metamx.druid.master.DruidMaster.becomeMaster(DruidMaster.java:435)

at com.metamx.druid.master.DruidMaster.start(DruidMaster.java:387)

... 7 more

Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /druid/indexesPath

at org.apache.zookeeper.KeeperException.create(KeeperException.java:102)

at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)

at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1243)

at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1271)

at org.I0Itec.zkclient.ZkConnection.getChildren(ZkConnection.java:99)

at org.I0Itec.zkclient.ZkClient$2.call(ZkClient.java:416)

at org.I0Itec.zkclient.ZkClient$2.call(ZkClient.java:413)

at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675)

... 14 more

Error on compute:

2012-10-31 00:13:08,509 INFO [main] com.metamx.druid.coordination.ZkCoordinator - Starting zkCoordinator for server[DruidServer{name='127.0.0.1', host='127.0.0.1', maxSize=300000000000, type=historical}] with config[com.metamx.druid.coordination.ZkCoordinatorConfig$$EnhancerByCGLIB$$dcc80a67@28f19d6e]

2012-10-31 00:13:08,596 ERROR [main] com.metamx.druid.http.ServerMain - Error when starting up.  Failing.

java.lang.reflect.InvocationTargetException

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

        at java.lang.reflect.Method.invoke(Method.java:597)

        at com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:108)

        at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:54)

        at com.metamx.druid.http.ServerMain.main(ServerMain.java:179)

Caused by: org.I0Itec.zkclient.exception.ZkNoNodeException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /druid/loadQueuePath

        at org.I0Itec.zkclient.exception.ZkException.create(ZkException.java:47)

        at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:685)

        at org.I0Itec.zkclient.ZkClient.create(ZkClient.java:304)

        at org.I0Itec.zkclient.ZkClient.createPersistent(ZkClient.java:213)

        at org.I0Itec.zkclient.ZkClient.createPersistent(ZkClient.java:192)

        at com.metamx.druid.client.ZKPhoneBook$InternalPhoneBook.post(ZKPhoneBook.java:237)

        at com.metamx.phonebook.BasePhoneBook.post(BasePhoneBook.java:141)

        at com.metamx.druid.coordination.ZkCoordinator.start(ZkCoordinator.java:104)

        ... 7 more

Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /druid/loadQueuePath

        at org.apache.zookeeper.KeeperException.create(KeeperException.java:102)

        at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)

        at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:637)

        at org.I0Itec.zkclient.ZkConnection.create(ZkConnection.java:87)

        at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:308)

        at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:304)

        at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675)

        ... 13 more

[Eric Tschetter]

Ah, that's happening because you haven't created the ZK locations yet.
The docs don't cover that you have to set that up. Ok, another area
to improve the docs.

You can create the necessary ZK locations (and the proper table in
MySQL) by running "com.metamx.druid.utils.ZkSetup". Usage is
basically

Usage: <java invocation> zkConnect baseZkPath dbConnectionUrl
dbUsername:password tableName

So

java -cp server/target/druid-server-version-selfcontained.jar
com.metamx.druid.utils.ZkSetup zkConnect baseZkPath etc etc.

We should really adjust that to run off of the same configuration file
that you use to run the cluster... I'll make an issue on the issue
tracker.

--Eric

> --
> You received this message because you are subscribed to the Google Groups
> "Druid Development" group.
> To post to this group, send email to druid-de...@googlegroups.com.
> To unsubscribe from this group, send email to
> druid-developm...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/druid-development/-/eLje6ZqEygQJ.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>

[Paul Baclace]

I will add a hook for these steps to the bash scripts I'm creating.  I created a generator (where bash generates bash) for init.d and upstart.  Next step is to test it out. 

Paul