设置worker.childopts，但是worker启动时候xms xmx等jvm参数没生效

[Li Siyu]

在storm.yaml里设置了nimbus、supervisor和worker的childopts，其中numbus和supervisor的opts生效了，但是worker的没有生效。

请问是什么问题？

storm.yaml配置如下：

```

storm.zookeeper.servers:

  - "172.27.36.85"

  - "172.27.36.86"

  - "172.27.36.87"

  - "172.27.36.98"

  - "172.27.36.99"

storm.zookeeper.root: "/jstorm2"

storm.local.dir: "/export/Data/jstream/data"

jstorm.log.dir: "/export/Logs/jstream-server"

java.library.path: "/usr/local/lib:/opt/local/lib:/usr/lib"

nimbus.host.start.supervisor: "true"

nimbus.host: "172.27.36.86"

topology.enable.classloader: true

supervisor.slots.ports:

    - 6800

    - 6801

    - 6802

    - 6803

    - 6804

    - 6805

    - 6806

    - 6807

    - 6808

    - 6809

worker.childopts: "-Xms3800m -Xmx3800m -Xmn1024m -Xss200m -XX:SurvivorRatio=2 -XX:+UseConcMarkSweepGC -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=65"

nimbus.childopts: "-Xms32g -Xmx32g -Xmn2048m -XX:PermSize=512m -XX:SurvivorRatio=4 -XX:+UseConcMarkSweepGC -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=70 -XX:CMSFullGCsBeforeCompaction=5 -XX:+HeapDumpOnOutOfMemoryError -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=5 -XX:GCLogFileSize=100M -XX:+UseCMSCompactAtFullCollection -XX:CMSMaxAbortablePrecleanTime=5000 "

supervisor.childopts: "-Xms32g -Xmx32g -Xmn1024m -XX:PermSize=128m -XX:+UseConcMarkSweepGC -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=70 -XX:CMSFullGCsBeforeCompaction=5 -XX:+HeapDumpOnOutOfMemoryError -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=5 -XX:GCLogFileSize=100M -XX:+UseCMSCompactAtFullCollection -XX:CMSMaxAbortablePrecleanTime=5000"

```

[Cody Innowhere]

应该是会生效的，贴一下worker进程的完整JVM进程呢。

[Li Siyu]

我在程序设置backtype.storm.Config，加上了opts生效了，设置如下：

conf.put(Config.TOPOLOGY_WORKER_CHILDOPTS, "-Xms32g -Xmx32g -Xmn2048m -Xss1024m");

但是storm.yaml设置的childopts还是无效。

也许是不是设置work.childopts，必须设置为topology.worker.childopts。

下面是worker的JVM进程

root      33406  89156 89 09:45 ?        00:13:54 java -server -Xms2147483648 -Xmx2147483648 -Xmn1073741824 -XX:PermSize=67108864 -XX:MaxPermSize=134217728 -XX:ParallelGCThreads=4 -Xms32g -Xmx32g -Xmn2048m -Xss1024m -Xloggc:/export/Logs/jstream-server/./MAS/MAS-24-1482889505-worker-6809-gc.log -verbose:gc -XX:HeapDumpPath=/export/Logs/jstream-server/./MAS/java-MAS-24-1482889505-20161228094506.hprof -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Djstorm.home=/export/servers/jstorm -Djstorm.log.dir=/export/Logs/jstream-server -Dlogfile.name=MAS-worker-6809.log -Dtopology.name=MAS -Dlogback.configurationFile=/export/servers/jstorm/conf/jstorm.logback.xml -cp /export/servers/jstorm/lib/jstorm-runtime-1.0.0.jar:/export/servers/jstorm/tp-agg-1.0-0.2.jar:/export/servers/jstorm/conf:/export/servers/jstorm/lib/junit-3.8.1.jar:/export/servers/jstorm/lib/log4j-over-slf4j-1.6.6.jar:/export/servers/jstorm/lib/httpclient-4.3.3.jar:/export/servers/jstorm/lib/slf4j-api-1.7.5.jar:/export/servers/jstorm/lib/kryo-2.21.jar:/export/servers/jstorm/lib/reflectasm-1.07-shaded.jar:/export/servers/jstorm/lib/curator-client-2.5.0.jar:/export/servers/jstorm/lib/logback-core-1.0.13.jar:/export/servers/jstorm/lib/chill-java-0.3.5.jar:/export/servers/jstorm/lib/guava-14.0.1.jar:/export/servers/jstorm/lib/carbonite-1.4.0.jar:/export/servers/jstorm/lib/commons-io-2.4.jar:/export/servers/jstorm/lib/json-simple-1.1.jar:/export/servers/jstorm/jstream-task02011835.jar:/export/servers/jstorm/lib/gson-2.3.1.jar:/export/servers/jstorm/lib/snakeyaml-1.11.jar:/export/servers/jstorm/tp-agg-1.0-12.jar:/export/servers/jstorm/lib/zookeeper-3.4.5.jar:/export/servers/jstorm/lib/servlet-api-2.5.jar:/export/servers/jstorm/lib/metrics-jvm-3.1.2.jar:/export/servers/jstorm/lib/disruptor-3.2.1.jar:/export/servers/jstorm/lib/libthrift-0.9.2.jar:/export/servers/jstorm/lib/jgrapht-core-0.9.0.jar:/export/servers/jstorm/lib/commons-cli-1.2.jar:/export/servers/jstorm/lib/commons-exec-1.1.jar:/export/servers/jstorm/lib/commons-logging-1.1.3.jar:/export/servers/jstorm/lib/commons-codec-1.6.jar:/export/servers/jstorm/mas.jar:/export/servers/jstorm/lib/commons-lang-2.5.jar:/export/servers/jstorm/lib/jstorm-core-2.1.0.jar:/export/servers/jstorm/lib/asm-4.0.jar:/export/servers/jstorm/lib/curator-framework-2.5.0.jar:/export/servers/jstorm/lib/netty-3.2.2.Final.jar:/export/servers/jstorm/lib/metrics-healthchecks-3.1.2.jar:/export/servers/jstorm/lib/httpcore-4.3.2.jar:/export/servers/jstorm/lib/clojure-1.6.0.jar:/export/servers/jstorm/lib/jline-0.9.94.jar:/export/servers/jstorm/lib/netty-3.9.0.Final.jar:/export/servers/jstorm/mas2.jar:/export/servers/jstorm/lib/logback-classic-1.0.13.jar:/export/servers/jstorm/lib/metrics-core-3.1.2.jar:/export/servers/jstorm/lib/rocksdbjni-3.10.1.jar:/export/servers/jstorm/lib/objenesis-1.2.jar com.alibaba.jstorm.daemon.worker.Worker MAS-24-1482889505 a8121ae0-7fc3-41b0-9a7c-0beec29048e6 6809 0e0432ae-a20a-4a77-bd4b-88084e47ffd4 null::/export/Data/jstream/data/supervisor/stormdist/MAS-24-1482889505/stormjar.jar &

在 2016年12月27日星期二 UTC+8下午11:52:22，Cody Innowhere写道：

[Li Siyu]

不对，topology.worker.childopts还是没有生效。

实际上每个worker还是2GB。

不知道怎么设置了

root      33406  89156 89 09:45 ?        00:13:54 java -server -Xms2147483648 -Xmx2147483648 -Xmn1073741824 -XX:PermSize=67108864 -XX:MaxPermSize=134217728 -XX:ParallelGCThreads=4 -Xms32g -Xmx32g -Xmn2048m -Xss1024m -Xloggc:/export/Logs/jstream-server/./MAS/MAS-24-1482889505-worker-6809-gc.log -verbose:gc -XX:HeapDumpPath=/export/Logs/jstream-server/./MAS/java-MAS-24-1482889505-20161228094506.hprof -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Djstorm.home=/export/servers/jstorm -Djstorm.log.dir=/export/Logs/jstream-server -Dlogfile.name=MAS-worker-6809.log -Dtopology.name=MAS -Dlogback.configurationFile=/export/servers/jstorm/conf/jstorm.logback.xml -cp /export/servers/jstorm/lib/jstorm-runtime-1.0.0.jar:/export/servers/jstorm/tp-agg-1.0-0.2.jar:/export/servers/jstorm/conf:/export/servers/jstorm/lib/junit-3.8.1.jar:/export/servers/jstorm/lib/log4j-over-slf4j-1.6.6.jar:/export/servers/jstorm/lib/httpclient-4.3.3.jar:/export/servers/jstorm/lib/slf4j-api-1.7.5.jar:/export/servers/jstorm/lib/kryo-2.21.jar:/export/servers/jstorm/lib/reflectasm-1.07-shaded.jar:/export/servers/jstorm/lib/curator-client-2.5.0.jar:/export/servers/jstorm/lib/logback-core-1.0.13.jar:/export/servers/jstorm/lib/chill-java-0.3.5.jar:/export/servers/jstorm/lib/guava-14.0.1.jar:/export/servers/jstorm/lib/carbonite-1.4.0.jar:/export/servers/jstorm/lib/commons-io-2.4.jar:/export/servers/jstorm/lib/json-simple-1.1.jar:/export/servers/jstorm/jstream-task02011835.jar:/export/servers/jstorm/lib/gson-2.3.1.jar:/export/servers/jstorm/lib/snakeyaml-1.11.jar:/export/servers/jstorm/tp-agg-1.0-12.jar:/export/servers/jstorm/lib/zookeeper-3.4.5.jar:/export/servers/jstorm/lib/servlet-api-2.5.jar:/export/servers/jstorm/lib/metrics-jvm-3.1.2.jar:/export/servers/jstorm/lib/disruptor-3.2.1.jar:/export/servers/jstorm/lib/libthrift-0.9.2.jar:/export/servers/jstorm/lib/jgrapht-core-0.9.0.jar:/export/servers/jstorm/lib/commons-cli-1.2.jar:/export/servers/jstorm/lib/commons-exec-1.1.jar:/export/servers/jstorm/lib/commons-logging-1.1.3.jar:/export/servers/jstorm/lib/commons-codec-1.6.jar:/export/servers/jstorm/mas.jar:/export/servers/jstorm/lib/commons-lang-2.5.jar:/export/servers/jstorm/lib/jstorm-core-2.1.0.jar:/export/servers/jstorm/lib/asm-4.0.jar:/export/servers/jstorm/lib/curator-framework-2.5.0.jar:/export/servers/jstorm/lib/netty-3.2.2.Final.jar:/export/servers/jstorm/lib/metrics-healthchecks-3.1.2.jar:/export/servers/jstorm/lib/httpcore-4.3.2.jar:/export/servers/jstorm/lib/clojure-1.6.0.jar:/export/servers/jstorm/lib/jline-0.9.94.jar:/export/servers/jstorm/lib/netty-3.9.0.Final.jar:/export/servers/jstorm/mas2.jar:/export/servers/jstorm/lib/logback-classic-1.0.13.jar:/export/servers/jstorm/lib/metrics-core-3.1.2.jar:/export/servers/jstorm/lib/rocksdbjni-3.10.1.jar:/export/servers/jstorm/lib/objenesis-1.2.jar com.alibaba.jstorm.daemon.worker.Worker MAS-24-1482889505 a8121ae0-7fc3-41b0-9a7c-0beec29048e6 6809 0e0432ae-a20a-4a77-bd4b-88084e47ffd4 null::/export/Data/jstream/data/supervisor/stormdist/MAS-24-1482889505/stormjar.jar &

在 2016年12月28日星期三 UTC+8上午10:03:44，Li Siyu写道：

[Guapo luis]

storm.yaml里面尝试设置worker.memory.size

默认是 worker.memory.size: 2147483648  2G

试试看

在 2016年12月27日星期二 UTC+8上午10:15:07，Li Siyu写道：