Lily start-up issue with Hbase and Zookeeper
138 views
Skip to first unread message
Bharath Bharath
Apr 30, 2015, 8:20:45 AM4/30/15
to lily-d...@googlegroups.com
Hello
conf/general/hbase.xml
conf/general/mapreduce.xml
conf/general/zookeeper.xml
conf/repository/repository.xml
conf/rpc/rpc.xml
Can anyone assist me to setup Lily Server in CDH on which i'm working....
While starting lily i'm getting the below Error.
Steps i followed :
1. Checked for the Hbase, Solr, Zookeeper Services
2. Placed the required JAR files from Lily folder to Hbase/lib folder
3. Configured the Proper Hostname with Port details in the below XML files.
conf/general/mapreduce.xml
conf/general/zookeeper.xml
conf/repository/repository.xml
conf/rpc/rpc.xml
Got below error and i'm trying this for a Demo showcasing.
Please help !!!!
org.apache.hadoop.hbase.regionserver.metrics.SchemaMetrics - Inconsistent configuration. Previous configuration for using table name in metrics: true, new configuration: false
org.lilyproject.runtime.LilyRTException: Error constructing module defined at /bin/lily-2.4/lib/org/lilyproject/lily-general-module/2.4/lily-general-module-2.4.jar
[root@in-air-bimap160 bin]# ./launch-test-lily [Location : /bin/lily-2.4/bin]
----------------------------------------------------------
Tip: for faster startup in the future, run once:
launch-test-lily --prepare
----------------------------------------------------------
[WARN ][17:44:05,727][main ] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
[WARN ][17:44:06,336][main ] org.apache.hadoop.conf.Configuration - hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping
[WARN ][17:44:07,967][main ] org.apache.hadoop.metrics2.impl.MetricsConfig - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[WARN ][17:44:14,296][0396053864] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Node /hbase/backup-masters/in-air-bimap160.corp.capgemini.com,43155,1430396053864 already deleted, and this is not a retry
[WARN ][17:44:14,301][0396053864] org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
[ERROR][17:44:15,172][0396053864] org.apache.hadoop.hbase.regionserver.metrics.SchemaMetrics - Inconsistent configuration. Previous configuration for using table name in metrics: true, new configuration: false
[FATAL][17:44:15,683][0396053864] org.apache.hadoop.hbase.master.HMaster - Master server abort: loaded coprocessors are: []
[FATAL][17:44:15,684][0396053864] org.apache.hadoop.hbase.master.HMaster - Unhandled exception. Starting shutdown.
java.net.BindException: Port in use: 0.0.0.0:60010
at org.apache.hadoop.http.HttpServer.openListener(HttpServer.java:729)
at org.apache.hadoop.http.HttpServer.start(HttpServer.java:673)
at org.apache.hadoop.hbase.master.HMaster.startServiceThreads(HMaster.java:880)
at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:529)
at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:362)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.net.BindException: Address already in use
at sun.nio.ch.Net.bind(Native Method)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:126)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59)
at org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
at org.apache.hadoop.http.HttpServer.openListener(HttpServer.java:725)
... 5 more
[WARN ][17:45:15,737][0396054242] org.apache.hadoop.hbase.regionserver.HRegionServer - Unable to connect to master. Retrying. Error was:
org.apache.hadoop.hbase.ipc.HBaseClient$FailedServerException: This server is in the failed servers list: in-air-bimap160.corp.cap.com/10.74.163.188:43155
at org.apache.hadoop.hbase.ipc.HBaseClient$Connection.setupIOstreams(HBaseClient.java:451)
at org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:1173)
at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:1008)
at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:150)
at $Proxy19.getProtocolVersion(Unknown Source)
at org.apache.hadoop.hbase.ipc.WritableRpcEngine.getProxy(WritableRpcEngine.java:183)
at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:338)
at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:315)
at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:367)
at org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:236)
at org.apache.hadoop.hbase.regionserver.HRegionServer.getMaster(HRegionServer.java:1864)
at org.apache.hadoop.hbase.regionserver.HRegionServer.reportForDuty(HRegionServer.java:1910)
at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:693)
at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:136)
at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.access$000(MiniHBaseCluster.java:89)
at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer$1.run(MiniHBaseCluster.java:120)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:337)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1388)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hbase.util.Methods.call(Methods.java:37)
at org.apache.hadoop.hbase.security.User.call(User.java:586)
at org.apache.hadoop.hbase.security.User.access$700(User.java:50)
at org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:426)
at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.run(MiniHBaseCluster.java:118)
at java.lang.Thread.run(Thread.java:662)
[ERROR][17:47:34,436][main ] org.apache.hadoop.hbase.MiniHBaseCluster - Error starting cluster
java.lang.RuntimeException: Master not initialized after 200 seconds
at org.apache.hadoop.hbase.util.JVMClusterUtil.startup(JVMClusterUtil.java:206)
at org.apache.hadoop.hbase.LocalHBaseCluster.startup(LocalHBaseCluster.java:420)
at org.apache.hadoop.hbase.MiniHBaseCluster.init(MiniHBaseCluster.java:196)
at org.apache.hadoop.hbase.MiniHBaseCluster.<init>(MiniHBaseCluster.java:76)
at org.lilyproject.hadooptestfw.fork.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:709)
at org.lilyproject.hadooptestfw.fork.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:683)
at org.lilyproject.hadooptestfw.fork.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:631)
at org.lilyproject.hadooptestfw.fork.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:618)
at org.lilyproject.lilyservertestfw.launcher.HadoopLauncherService.start(HadoopLauncherService.java:66)
at org.lilyproject.lilyservertestfw.launcher.LilyLauncher.run(LilyLauncher.java:229)
at org.lilyproject.cli.BaseCliTool.runBase(BaseCliTool.java:233)
at org.lilyproject.cli.BaseCliTool.start(BaseCliTool.java:63)
at org.lilyproject.lilyservertestfw.launcher.LilyLauncher.main(LilyLauncher.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.lilyproject.lilyservertestfwloader.ClassLoadingLilyLauncher.run(ClassLoadingLilyLauncher.java:71)
at org.lilyproject.lilyservertestfwloader.ClassLoadingLilyLauncher.launch(ClassLoadingLilyLauncher.java:49)
at org.lilyproject.lilyservertestfwloader.ClassLoadingLilyLauncher.main(ClassLoadingLilyLauncher.java:45)
[WARN ][17:47:34,438][main ] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/shutdown
[WARN ][17:47:34,639][main ] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/shutdown
[WARN ][17:47:35,039][main ] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/shutdown
[WARN ][17:47:35,839][main ] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/shutdown
[ERROR][17:47:35,840][main ] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - ZooKeeper delete failed after 3 retries
[ERROR][17:47:35,840][main ] org.apache.hadoop.hbase.master.HMaster - ZooKeeper exception trying to set cluster as down in ZK
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/shutdown
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.delete(RecoverableZooKeeper.java:137)
at org.apache.hadoop.hbase.zookeeper.ZKUtil.deleteNode(ZKUtil.java:1215)
at org.apache.hadoop.hbase.zookeeper.ZKUtil.deleteNode(ZKUtil.java:1204)
at org.apache.hadoop.hbase.zookeeper.ClusterStatusTracker.setClusterDown(ClusterStatusTracker.java:80)
at org.apache.hadoop.hbase.master.HMaster.shutdown(HMaster.java:1614)
at org.apache.hadoop.hbase.util.JVMClusterUtil.shutdown(JVMClusterUtil.java:234)
at org.apache.hadoop.hbase.LocalHBaseCluster.shutdown(LocalHBaseCluster.java:427)
at org.apache.hadoop.hbase.MiniHBaseCluster.shutdown(MiniHBaseCluster.java:416)
at org.apache.hadoop.hbase.MiniHBaseCluster.init(MiniHBaseCluster.java:202)
at org.apache.hadoop.hbase.MiniHBaseCluster.<init>(MiniHBaseCluster.java:76)
at org.lilyproject.hadooptestfw.fork.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:709)
at org.lilyproject.hadooptestfw.fork.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:683)
at org.lilyproject.hadooptestfw.fork.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:631)
at org.lilyproject.hadooptestfw.fork.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:618)
at org.lilyproject.lilyservertestfw.launcher.HadoopLauncherService.start(HadoopLauncherService.java:66)
at org.lilyproject.lilyservertestfw.launcher.LilyLauncher.run(LilyLauncher.java:229)
at org.lilyproject.cli.BaseCliTool.runBase(BaseCliTool.java:233)
at org.lilyproject.cli.BaseCliTool.start(BaseCliTool.java:63)
at org.lilyproject.lilyservertestfw.launcher.LilyLauncher.main(LilyLauncher.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.lilyproject.lilyservertestfwloader.ClassLoadingLilyLauncher.run(ClassLoadingLilyLauncher.java:71)
at org.lilyproject.lilyservertestfwloader.ClassLoadingLilyLauncher.launch(ClassLoadingLilyLauncher.java:49)
at org.lilyproject.lilyservertestfwloader.ClassLoadingLilyLauncher.main(ClassLoadingLilyLauncher.java:45)
[WARN ][17:47:35,847][0396054242] org.apache.hadoop.hbase.regionserver.HRegionServer - reportForDuty failed; sleeping and then retrying.
[WARN ][17:47:35,877][0396054242] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/rs/in-air-bimap160.corp.cap.com,36250,1430396054242
[WARN ][17:47:36,077][0396054242] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/rs/in-air-bimap160.corp.cap.com,36250,1430396054242
[WARN ][17:47:36,478][0396054242] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/rs/in-air-bimap160.corp.cap.com,36250,1430396054242
[WARN ][17:47:37,278][0396054242] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/rs/in-air-bimap160.corp.cap.com,36250,1430396054242
[ERROR][17:47:37,278][0396054242] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - ZooKeeper delete failed after 3 retries
[WARN ][17:47:37,279][0396054242] org.apache.hadoop.hbase.regionserver.HRegionServer - Failed deleting my ephemeral node
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/rs/in-air-bimap160.corp.cap.com,36250,1430396054242
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.delete(RecoverableZooKeeper.java:137)
at org.apache.hadoop.hbase.zookeeper.ZKUtil.deleteNode(ZKUtil.java:1215)
at org.apache.hadoop.hbase.zookeeper.ZKUtil.deleteNode(ZKUtil.java:1204)
at org.apache.hadoop.hbase.regionserver.HRegionServer.deleteMyEphemeralNode(HRegionServer.java:1068)
at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:846)
at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:136)
at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.access$000(MiniHBaseCluster.java:89)
at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer$1.run(MiniHBaseCluster.java:120)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:337)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1388)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hbase.util.Methods.call(Methods.java:37)
at org.apache.hadoop.hbase.security.User.call(User.java:586)
at org.apache.hadoop.hbase.security.User.access$700(User.java:50)
at org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:426)
at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.run(MiniHBaseCluster.java:118)
at java.lang.Thread.run(Thread.java:662)
java.io.IOException: Shutting down
at org.apache.hadoop.hbase.MiniHBaseCluster.init(MiniHBaseCluster.java:203)
at org.apache.hadoop.hbase.MiniHBaseCluster.<init>(MiniHBaseCluster.java:76)
at org.lilyproject.hadooptestfw.fork.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:709)
at org.lilyproject.hadooptestfw.fork.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:683)
at org.lilyproject.hadooptestfw.fork.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:631)
at org.lilyproject.hadooptestfw.fork.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:618)
at org.lilyproject.lilyservertestfw.launcher.HadoopLauncherService.start(HadoopLauncherService.java:66)
at org.lilyproject.lilyservertestfw.launcher.LilyLauncher.run(LilyLauncher.java:229)
at org.lilyproject.cli.BaseCliTool.runBase(BaseCliTool.java:233)
at org.lilyproject.cli.BaseCliTool.start(BaseCliTool.java:63)
at org.lilyproject.lilyservertestfw.launcher.LilyLauncher.main(LilyLauncher.java:137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.lilyproject.lilyservertestfwloader.ClassLoadingLilyLauncher.run(ClassLoadingLilyLauncher.java:71)
at org.lilyproject.lilyservertestfwloader.ClassLoadingLilyLauncher.launch(ClassLoadingLilyLauncher.java:49)
at org.lilyproject.lilyservertestfwloader.ClassLoadingLilyLauncher.main(ClassLoadingLilyLauncher.java:45)
java.lang.RuntimeException: Master not initialized after 200 seconds
at org.apache.hadoop.hbase.util.JVMClusterUtil.startup(JVMClusterUtil.java:206)
at org.apache.hadoop.hbase.LocalHBaseCluster.startup(LocalHBaseCluster.java:420)
at org.apache.hadoop.hbase.MiniHBaseCluster.init(MiniHBaseCluster.java:196)
... 17 more
Would prefer for live conversation or Chat.
Please do let me know, if i need to provide anymore info.
Regards
Bharath
Karel Vervaeke
Apr 30, 2015, 9:30:41 AM4/30/15
to lily-d...@googlegroups.com
launch-test-lily is only intended for development and for exploring Lily functionality. It should be run in an environment where hdfs, zookeeper and hbase are not present: This tool gives you a sandbox environment and takes care of starting all the required services.
If you want to run Lily in a real environment you should probably use the lily-server command.
Regards,
Karel
--
You received this message because you are subscribed to the Google Groups "lily-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to lily-discuss...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Bharath Bharath
Apr 30, 2015, 1:08:32 PM4/30/15
to lily-d...@googlegroups.com
Hi Karel
I'm Happy to see your reply and please review my below details which i have provided.
Now i have used the # ./lily-server, but still i'm getting error due to insufficient Knowledge on CDH environment.
i'm running this for a POC which should be ready by 48hrs. I'm just stuck-up somewhere here.
[root@in-air-bimap160 bin]# ./lily-server
[INFO ][22:38:02,370][main ] org.lilyproject.runtime.info - Starting the Lily Runtime.
[INFO ][22:38:02,464][main ] org.lilyproject.runtime.info - Reading module configurations of 11 modules.
[INFO ][22:38:03,094][main ] org.lilyproject.runtime.info - Starting the modules.
[INFO ][22:38:03,107][main ] org.lilyproject.runtime.info - Starting module pluginregistry - /bin/lily-2.4/lib/org/lilyproject/lily-pluginregistry-impl/2.4/lily-pluginregistry-impl-2.4.jar
[INFO ][22:38:03,953][main ] org.lilyproject.runtime.info - Starting module servletregistry - /bin/lily-2.4/lib/org/lilyproject/lily-servletregistry-module/2.4/lily-servletregistry-module-2.4.jar
[INFO ][22:38:04,140][main ] org.lilyproject.runtime.info - Starting module general - /bin/lily-2.4/lib/org/lilyproject/lily-general-module/2.4/lily-general-module-2.4.jar
org.lilyproject.runtime.LilyRTException: Error constructing module defined at /bin/lily-2.4/lib/org/lilyproject/lily-general-module/2.4/lily-general-module-2.4.jar
at org.lilyproject.runtime.module.build.ModuleBuilder.buildInt(ModuleBuilder.java:115)
at org.lilyproject.runtime.module.build.ModuleBuilder.build(ModuleBuilder.java:51)
at org.lilyproject.runtime.LilyRuntime.start(LilyRuntime.java:223)
at org.lilyproject.runtime.cli.LilyRuntimeCli.run(LilyRuntimeCli.java:293)
at org.lilyproject.runtime.cli.LilyRuntimeCli.main(LilyRuntimeCli.java:67)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.lilyproject.runtime.launcher.LilyRuntimeCliLauncher.run(LilyRuntimeCliLauncher.java:80)
at org.lilyproject.runtime.launcher.LilyRuntimeCliLauncher.launch(LilyRuntimeCliLauncher.java:59)
at org.lilyproject.runtime.launcher.LilyRuntimeCliLauncher.main(LilyRuntimeCliLauncher.java:55)
Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hbaseConfiguration' defined in LILY-INF/spring/services.xml in /bin/lily-2.4/lib/org/lilyproject/lily-general-module/2.4/lily-general-module-2.4.jar: Instantiation of bean failed; nested exception is org.springframework.beans.BeanInstantiationException: Could not instantiate bean class [org.lilyproject.server.modules.general.HadoopConfigurationFactoryImpl]: Constructor threw exception; nested exception is org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find region for after 10 tries.
at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:288)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1049)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:953)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:490)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:461)
at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:295)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:292)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:194)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:626)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:932)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:479)
at org.lilyproject.runtime.module.build.ModuleBuilder.buildInt(ModuleBuilder.java:84)
... 11 more
Caused by: org.springframework.beans.BeanInstantiationException: Could not instantiate bean class [org.lilyproject.server.modules.general.HadoopConfigurationFactoryImpl]: Constructor threw exception; nested exception is org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find region for after 10 tries.
at org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:163)
at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:121)
at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:280)
... 23 more
Caused by: org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find region for after 10 tries.
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:953)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:858)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:819)
at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:271)
at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:211)
at org.lilyproject.server.modules.general.HadoopConfigurationFactoryImpl.waitOnHBase(HadoopConfigurationFactoryImpl.java:67)
at org.lilyproject.server.modules.general.HadoopConfigurationFactoryImpl.<init>(HadoopConfigurationFactoryImpl.java:53)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:148)
... 25 more
Startup failed. Will try to shutdown and exit.
[INFO ][22:48:05,572][main ] org.lilyproject.runtime.info - Shutting down the modules.
Request your help on this.....
Bharath
Bharath Bharath
May 3, 2015, 8:34:39 AM5/3/15
to lily-d...@googlegroups.com
Can someone help me, Please.
Steven Noels
May 3, 2015, 8:39:25 AM5/3/15
to lily-d...@googlegroups.com, Bharath Bharath
Hi,
check the error message. I shows that you are trying duplicate processes - just as my colleague was indicating already. See below.
Steven.
--
Bharath Bharath
May 4, 2015, 1:08:36 AM5/4/15
to lily-d...@googlegroups.com, raz...@gmail.com
Hi Steven
Thanks for highlighting.
I got a wrong log files. Please find the below details for the same. Also i have checked for the duplicate process, but still the same.
[root@in-air-bimap160 bin]# ./launch-test-lily
----------------------------------------------------------
Tip: for faster startup in the future, run once:
launch-test-lily --prepare
----------------------------------------------------------
[WARN ][10:40:53,814][main ] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
[WARN ][10:40:54,878][main ] org.apache.hadoop.conf.Configuration - hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping
[WARN ][10:40:57,441][main ] org.apache.hadoop.metrics2.impl.MetricsConfig - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[WARN ][10:41:08,704][0716267765] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Node /hbase/backup-masters/localhost,50783,1430716267765 already deleted, and this is not a retry
[WARN ][10:41:08,733][0716267765] org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
[ERROR][10:41:10,059][0716267765] org.apache.hadoop.hbase.regionserver.metrics.SchemaMetrics - Inconsistent configuration. Previous configuration for using table name in metrics: true, new configuration: false
[WARN ][10:41:13,116][0716267765] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Node /hbase/root-region-server already deleted, and this is not a retry
[WARN ][10:41:13,171][0716267765] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Node /hbase/table/-ROOT- already deleted, and this is not a retry
[WARN ][10:41:14,730][0716267765] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Node /hbase/table/.META. already deleted, and this is not a retry
Generating rack names for tasktrackers
[WARN ][10:41:15,680][Thread-203] org.apache.hadoop.conf.Configuration - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
[ERROR][10:41:16,316][Thread-203] org.apache.hadoop.security.UserGroupInformation - PriviledgedActionException as:root (auth:SIMPLE) cause:java.net.BindException: Problem binding to [localhost:9001] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException
[ERROR][10:41:16,318][Thread-203] org.apache.hadoop.mapred.MiniMRCluster - Job tracker crashed
java.net.BindException: Problem binding to [localhost:9001] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:715)
at org.apache.hadoop.ipc.Server.bind(Server.java:356)
at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:454)
at org.apache.hadoop.ipc.Server.<init>(Server.java:1835)
at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:970)
at org.apache.hadoop.ipc.WritableRpcEngine$Server.<init>(WritableRpcEngine.java:365)
at org.apache.hadoop.ipc.WritableRpcEngine.getServer(WritableRpcEngine.java:287)
at org.apache.hadoop.ipc.RPC.getServer(RPC.java:695)
at org.apache.hadoop.ipc.RPC.getServer(RPC.java:684)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1844)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1747)
at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:305)
at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner$1.run(MiniMRCluster.java:115)
at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner$1.run(MiniMRCluster.java:113)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner.run(MiniMRCluster.java:113)
at java.lang.Thread.run(Thread.java:662)
[WARN ][10:41:16,678][main ] org.apache.hadoop.conf.Configuration - slave.host.name is deprecated. Instead, use dfs.datanode.hostname
[WARN ][10:41:16,746][main ] org.apache.hadoop.conf.Configuration - session.id is deprecated. Instead, use dfs.metrics.session-id
[WARN ][10:41:17,004][main ] org.apache.hadoop.mapred.TaskTracker - TaskTracker's totalMemoryAllottedForTasks is -1 and reserved physical memory is not configured. TaskMemoryManager is disabled.
Regards
Bharath
On Sunday, May 3, 2015 at 6:09:25 PM UTC+5:30, Steven Noels wrote:
Hi,
check the error message. I shows that you are trying duplicate processes - just as my colleague was indicating already. See below.
Steven.
...
Bharath Bharath
May 4, 2015, 1:10:42 AM5/4/15
to lily-d...@googlegroups.com, raz...@gmail.com
Hi Steven
If you can provide me the steps to check and install Lily, it would be great.
I have referred, the steps given in below and followed
but still facing difficulty.
Thanks & Regards
Bharath
...
Reply all
Reply to author
Forward
0 new messages