Groups keyboard shortcuts have been updated
Dismiss
See shortcuts

本地(Mac)启动nimbus成功,但一直未连接Zookeeper,求大神指导

12 views
Skip to first unread message

che...@cai-inc.com

unread,
Aug 26, 2018, 3:33:26 AM8/26/18
to jstorm
jstorm nimbus 启动:

  ~ jstorm nimbus

/usr/bin/java


Running: java -server -Djstorm.home=/Users/huangshang/github/jstorm-2.2.1 -Dstorm.options= -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib:/usr/local/Cellar/zeromq/4.2.5:/Users/huangshang/github/jstorm-2.2.1/lib  -Xms4g -Xmx4g -Xmn1536m -XX:PermSize=256m  -XX:SurvivorRatio=4 -XX:+UseConcMarkSweepGC  -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=70 -XX:CMSFullGCsBeforeCompaction=5 -XX:+HeapDumpOnOutOfMemoryError -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=5 -XX:GCLogFileSize=100M -XX:+UseCMSCompactAtFullCollection -XX:CMSMaxAbortablePrecleanTime=5000  -Xloggc:/Users/huangshang/github/jstorm-2.2.1/logs/nimbus-gc-1535268131.log -Dlogfile.name=nimbus.log -Dlogback.configurationFile=/Users/huangshang/github/jstorm-2.2.1/conf/jstorm.logback.xml -Djstorm.log.dir=/Users/huangshang/github/jstorm-2.2.1/logs  -cp /Users/huangshang/github/jstorm-2.2.1/conf:/Users/huangshang/github/jstorm-2.2.1/lib/ext//*::/Users/huangshang/github/jstorm-2.2.1/jstorm-core-2.2.1.jar:/Users/huangshang/github/jstorm-2.2.1/lib/clojure-1.6.0.jar:/Users/huangshang/github/jstorm-2.2.1/lib/commons-logging-1.1.3.jar:/Users/huangshang/github/jstorm-2.2.1/lib/jedis-2.9.0.jar:/Users/huangshang/github/jstorm-2.2.1/lib/log4j-over-slf4j-1.6.6.jar:/Users/huangshang/github/jstorm-2.2.1/lib/logback-classic-1.0.13.jar:/Users/huangshang/github/jstorm-2.2.1/lib/logback-core-1.0.13.jar:/Users/huangshang/github/jstorm-2.2.1/lib/netty-3.9.0.Final.jar:/Users/huangshang/github/jstorm-2.2.1/lib/rocksdbjni-4.3.1.jar:/Users/huangshang/github/jstorm-2.2.1/lib/servlet-api-2.5.jar:/Users/huangshang/github/jstorm-2.2.1/lib/slf4j-api-1.7.5.jar:/Users/huangshang/github/jstorm-2.2.1/lib/storm-core-1.1.1.jar:/Users/huangshang/github/jstorm-2.2.1/lib/storm-redis-1.1.1.jar com.alibaba.jstorm.daemon.nimbus.NimbusServer 

Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=256m; support was removed in 8.0

Java HotSpot(TM) 64-Bit Server VM warning: UseCMSCompactAtFullCollection is deprecated and will likely be removed in a future release.

Java HotSpot(TM) 64-Bit Server VM warning: CMSFullGCsBeforeCompaction is deprecated and will likely be removed in a future release.



nimbus.log无报错

[INFO 2018-08-26 15:22:15 c.a.j.b.FileBlobStoreImpl:104 main] Creating new blob store based in /Users/huangshang/github/jstorm-2.2.1/data/blobs

[INFO 2018-08-26 15:22:15 c.a.j.c.DefaultWatcherCallBack:40 main-EventThread] Zookeeper state update::connected,:none,null

[INFO 2018-08-26 15:22:15 c.a.j.c.DistributedClusterState:86 main-EventThread] Received event SyncConnected:None:null

[INFO 2018-08-26 15:22:15 c.a.j.d.n.NimbusCache:72 main] NimbusCache db Cache will use com.alibaba.jstorm.cache.RocksDBCache

[INFO 2018-08-26 15:22:15 c.a.j.c.RocksDBCache:54 main] RocksDB reset is true

[INFO 2018-08-26 15:22:15 c.a.j.c.RocksDBCache:83 main] Begin to init rocksDB of /Users/huangshang/github/jstorm-2.2.1/data/nimbus/rocksdb

[INFO 2018-08-26 15:22:15 c.a.j.c.RocksDBCache:90 main] Successfully init rocksDB of /Users/huangshang/github/jstorm-2.2.1/data/nimbus/rocksdb

[INFO 2018-08-26 15:22:15 c.a.j.c.TimeoutMemCache:48 main] Successfully register CacheWindow: 60

[INFO 2018-08-26 15:22:15 c.a.j.c.RocksDBCache:54 main] RocksDB reset is false

[INFO 2018-08-26 15:22:15 c.a.j.c.RocksDBCache:83 main] Begin to init rocksDB of /Users/huangshang/github/jstorm-2.2.1/data/metrics/rocksdb

[INFO 2018-08-26 15:22:15 c.a.j.c.RocksDBCache:90 main] Successfully init rocksDB of /Users/huangshang/github/jstorm-2.2.1/data/metrics/rocksdb

[INFO 2018-08-26 15:22:15 c.a.j.s.FollowerRunnable:259 main] This nimbus can be  leader

[INFO 2018-08-26 15:22:15 c.a.j.d.n.NimbusServer:341 main] Successfully init Follower thread

[INFO 2018-08-26 15:22:15 c.a.j.s.FollowerRunnable:174 Thread-10] Follower Thread starts!

[INFO 2018-08-26 15:22:15 c.a.j.d.s.Httpserver:99 main] logview logDir=/Users/huangshang/github/jstorm-2.2.1/logs/.

[INFO 2018-08-26 15:22:15 c.a.j.d.s.Httpserver:795 main] Success start HttpServer at port:8621

[INFO 2018-08-26 15:22:15 c.a.j.d.n.NimbusServer:320 main] Successfully started nimbus: started Thrift server...

[INFO 2018-08-26 15:22:20 c.a.j.d.n.NimbusUtils:326 Thread-10] Successfully cleanup all old toplogies

[INFO 2018-08-26 15:22:20 c.a.j.d.n.TopologyAssign:128 TopologyAssign] TopologyAssign thread has been started

[INFO 2018-08-26 15:22:20 c.a.j.d.n.NimbusServer:258 Thread-10] Successfully init topology status

[INFO 2018-08-26 15:22:20 c.a.j.d.n.NimbusServer:298 Thread-10] Successfully init /Users/huangshang/github/jstorm-2.2.1/data/nimbus/inbox cleaner

[INFO 2018-08-26 15:22:20 c.a.j.d.n.NimbusServer:273 Thread-10] Successfully init Monitor thread

^[[A[INFO 2018-08-26 15:22:40 b.s.s.a.ThriftClient:108 CheckMetricMetaThread] masterHost:192.168.0.109:8627

[INFO 2018-08-26 15:23:00 b.s.s.a.ThriftClient:108 FlushMetricThread] masterHost:192.168.0.109:8627

[INFO 2018-08-26 15:30:23 b.s.s.a.ThriftClient:108 CheckMetricMetaThread] masterHost:192.168.0.109:8627

[INFO 2018-08-26 15:31:00 b.s.s.a.ThriftClient:108 FlushMetricThread] masterHost:192.168.0.109:8627





conf/storm.yaml配置

########### These MUST be filled in for a storm configuration

  2  storm.zookeeper.servers:

  3      - "127.0.0.1"

  4 

  5  storm.zookeeper.root: "/jstorm"

  6 

  7  cluster.name: "huangshang-jstorm-cluster"

  8 

  9  #nimbus.host/nimbus.host.start.supervisor is being used by $JSTORM_HOME/bin/start.sh

 10  #it only support IP, please don't set hostname

 11  # For example

 12  # nimbus.host: "10.132.168.10, 10.132.168.45"

 13  nimbus.host: "127.0.0.1"

 14  nimbus.host.start.supervisor: true

 15 



但Zookeeper上一直没有这个nimbus

[zk: localhost:2181(CONNECTED) 30] ls /jstorm

[nimbus_master, assignments, taskbeats, nimbus_slave, topology, assignments_bak, metrics, taskerrors, nimbus_slave_detail, tasks, supervisors, blobstore]

[zk: localhost:2181(CONNECTED) 31] ls /jstorm/nimbus_master

[]

[zk: localhost:2181(CONNECTED) 32] 






Reply all
Reply to author
Forward
0 new messages