elasticsearch can not set network.host:0.0.0.0

[qin....@gmail.com]

Hi,

Recently our wauzh needs to interact with other systems. Need to develop the elasticsearch port to run other system access to call wazuh data.

But after setting the network.host in the elasticsearch.yml file to 0.0.0.0, restarting elasticsearch will report an error.

[2019-03-21T10:19:50,397][INFO ][o.e.n.Node               ] [_DmjfZJ] stopping ...

[2019-03-21T10:19:51,812][INFO ][o.e.n.Node               ] [_DmjfZJ] stopped

[2019-03-21T10:19:51,813][INFO ][o.e.n.Node               ] [_DmjfZJ] closing ...

[2019-03-21T10:19:52,172][INFO ][o.e.n.Node               ] [_DmjfZJ] closed

[2019-03-21T10:20:00,400][WARN ][o.e.b.JNANatives         ] Unable to lock JVM Memory: error=12, reason=Cannot allocate memory

[2019-03-21T10:20:00,402][WARN ][o.e.b.JNANatives         ] This can result in part of the JVM being swapped out.

[2019-03-21T10:20:00,402][WARN ][o.e.b.JNANatives         ] Increase RLIMIT_MEMLOCK, soft limit: 65536, hard limit: 65536

[2019-03-21T10:20:00,402][WARN ][o.e.b.JNANatives         ] These can be adjusted by modifying /etc/security/limits.conf, for example:

        # allow user 'elasticsearch' mlockall

        elasticsearch soft memlock unlimited

        elasticsearch hard memlock unlimited

[2019-03-21T10:20:00,402][WARN ][o.e.b.JNANatives         ] If you are logged in interactively, you will have to re-login for the new limits to take effect.

[2019-03-21T10:20:00,691][INFO ][o.e.n.Node               ] [] initializing ...

[2019-03-21T10:20:00,801][INFO ][o.e.e.NodeEnvironment    ] [_DmjfZJ] using [1] data paths, mounts [[/ (/dev/xvda1)]], net usable_space [47.5gb], net total_space [255.7gb], types [ext4]

[2019-03-21T10:20:00,802][INFO ][o.e.e.NodeEnvironment    ] [_DmjfZJ] heap size [4.9gb], compressed ordinary object pointers [true]

[2019-03-21T10:20:03,326][INFO ][o.e.n.Node               ] node name [_DmjfZJ] derived from node ID [_DmjfZJTTfSYRXbbrtdofw]; set [node.name] to override

[2019-03-21T10:20:03,326][INFO ][o.e.n.Node               ] version[6.2.3], pid[21651], build[c59ff00/2018-03-13T10:06:29.741383Z], OS[Linux/4.4.0-139-generic/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_171/25.171-b11]

[2019-03-21T10:20:03,326][INFO ][o.e.n.Node               ] JVM arguments [-Xms5g, -Xmx5g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch.CbaXAEwK, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/elasticsearch, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -Xloggc:/var/log/elasticsearch/gc.log, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/etc/elasticsearch]

[2019-03-21T10:20:04,339][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [aggs-matrix-stats]

[2019-03-21T10:20:04,339][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [analysis-common]

[2019-03-21T10:20:04,339][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [ingest-common]

[2019-03-21T10:20:04,339][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [lang-expression]

[2019-03-21T10:20:04,339][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [lang-mustache]

[2019-03-21T10:20:04,340][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [lang-painless]

[2019-03-21T10:20:04,340][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [mapper-extras]

[2019-03-21T10:20:04,340][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [parent-join]

[2019-03-21T10:20:04,340][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [percolator]

[2019-03-21T10:20:04,340][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [rank-eval]

[2019-03-21T10:20:04,340][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [reindex]

[2019-03-21T10:20:04,340][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [repository-url]

[2019-03-21T10:20:04,340][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [transport-netty4]

[2019-03-21T10:20:04,340][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [tribe]

[2019-03-21T10:20:04,341][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] no plugins loaded

[2019-03-21T10:20:10,231][INFO ][o.e.d.DiscoveryModule    ] [_DmjfZJ] using discovery type [zen]

[2019-03-21T10:20:10,872][INFO ][o.e.n.Node               ] initialized

[2019-03-21T10:20:10,872][INFO ][o.e.n.Node               ] [_DmjfZJ] starting ...

[2019-03-21T10:20:11,067][INFO ][o.e.t.TransportService   ] [_DmjfZJ] publish_address {10.129.3.46:9300}, bound_addresses {0.0.0.0:9300}

[2019-03-21T10:20:11,472][INFO ][o.e.b.BootstrapChecks    ] [_DmjfZJ] bound or publishing to a non-loopback address, enforcing bootstrap checks

[2019-03-21T10:20:11,475][ERROR][o.e.b.Bootstrap          ] [_DmjfZJ] node validation exception

[1] bootstrap checks failed

[1]: memory locking requested for elasticsearch process but memory is not locked

[2019-03-21T10:20:11,486][INFO ][o.e.n.Node               ] [_DmjfZJ] stopping ...

[2019-03-21T10:20:11,675][INFO ][o.e.n.Node               ] [_DmjfZJ] stopped

[2019-03-21T10:20:11,675][INFO ][o.e.n.Node               ] [_DmjfZJ] closing ...

[2019-03-21T10:20:11,702][INFO ][o.e.n.Node               ] [_DmjfZJ] closed

[2019-03-21T10:20:38,942][WARN ][o.e.b.JNANatives         ] Unable to lock JVM Memory: error=12, reason=Cannot allocate memory

[2019-03-21T10:20:38,945][WARN ][o.e.b.JNANatives         ] This can result in part of the JVM being swapped out.

[2019-03-21T10:20:38,945][WARN ][o.e.b.JNANatives         ] Increase RLIMIT_MEMLOCK, soft limit: 65536, hard limit: 65536

[2019-03-21T10:20:38,946][WARN ][o.e.b.JNANatives         ] These can be adjusted by modifying /etc/security/limits.conf, for example:

        # allow user 'elasticsearch' mlockall

        elasticsearch soft memlock unlimited

        elasticsearch hard memlock unlimited

[2019-03-21T10:20:38,946][WARN ][o.e.b.JNANatives         ] If you are logged in interactively, you will have to re-login for the new limits to take effect.

[2019-03-21T10:20:39,131][INFO ][o.e.n.Node               ] [] initializing ...

[2019-03-21T10:20:39,205][INFO ][o.e.e.NodeEnvironment    ] [_DmjfZJ] using [1] data paths, mounts [[/ (/dev/xvda1)]], net usable_space [47.5gb], net total_space [255.7gb], types [ext4]

[2019-03-21T10:20:39,206][INFO ][o.e.e.NodeEnvironment    ] [_DmjfZJ] heap size [4.9gb], compressed ordinary object pointers [true]

[2019-03-21T10:20:41,261][INFO ][o.e.n.Node               ] node name [_DmjfZJ] derived from node ID [_DmjfZJTTfSYRXbbrtdofw]; set [node.name] to override

[2019-03-21T10:20:41,262][INFO ][o.e.n.Node               ] version[6.2.3], pid[21801], build[c59ff00/2018-03-13T10:06:29.741383Z], OS[Linux/4.4.0-139-generic/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_171/25.171-b11]

[2019-03-21T10:20:41,262][INFO ][o.e.n.Node               ] JVM arguments [-Xms5g, -Xmx5g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch.uPM1wm0K, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/elasticsearch, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -Xloggc:/var/log/elasticsearch/gc.log, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/etc/elasticsearch]

[2019-03-21T10:20:41,935][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [aggs-matrix-stats]

[2019-03-21T10:20:41,935][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [analysis-common]

[2019-03-21T10:20:41,935][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [ingest-common]

[2019-03-21T10:20:41,936][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [lang-expression]

[2019-03-21T10:20:41,936][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [lang-mustache]

[2019-03-21T10:20:41,936][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [lang-painless]

[2019-03-21T10:20:41,936][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [mapper-extras]

[2019-03-21T10:20:41,936][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [parent-join]

[2019-03-21T10:20:41,936][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [percolator]

[2019-03-21T10:20:41,936][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [rank-eval]

[2019-03-21T10:20:41,936][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [reindex]

[2019-03-21T10:20:41,936][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [repository-url]

[2019-03-21T10:20:41,936][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [transport-netty4]

[2019-03-21T10:20:41,937][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [tribe]

[2019-03-21T10:20:41,937][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] no plugins loaded

[2019-03-21T10:20:46,290][INFO ][o.e.d.DiscoveryModule    ] [_DmjfZJ] using discovery type [zen]

[2019-03-21T10:20:47,048][INFO ][o.e.n.Node               ] initialized

[2019-03-21T10:20:47,048][INFO ][o.e.n.Node               ] [_DmjfZJ] starting ...

[2019-03-21T10:20:47,194][INFO ][o.e.t.TransportService   ] [_DmjfZJ] publish_address {10.129.3.46:9300}, bound_addresses {0.0.0.0:9300}

[2019-03-21T10:20:47,555][INFO ][o.e.b.BootstrapChecks    ] [_DmjfZJ] bound or publishing to a non-loopback address, enforcing bootstrap checks

[2019-03-21T10:20:47,558][ERROR][o.e.b.Bootstrap          ] [_DmjfZJ] node validation exception

[1] bootstrap checks failed

[1]: memory locking requested for elasticsearch process but memory is not locked

[2019-03-21T10:20:47,565][INFO ][o.e.n.Node               ] [_DmjfZJ] stopping ...

[2019-03-21T10:20:47,595][INFO ][o.e.n.Node               ] [_DmjfZJ] stopped

[2019-03-21T10:20:47,595][INFO ][o.e.n.Node               ] [_DmjfZJ] closing ...

[2019-03-21T10:20:47,609][INFO ][o.e.n.Node               ] [_DmjfZJ] closed

[2019-03-21T10:22:34,741][WARN ][o.e.b.JNANatives         ] Unable to lock JVM Memory: error=12, reason=Cannot allocate memory

[2019-03-21T10:22:34,743][WARN ][o.e.b.JNANatives         ] This can result in part of the JVM being swapped out.

[2019-03-21T10:22:34,743][WARN ][o.e.b.JNANatives         ] Increase RLIMIT_MEMLOCK, soft limit: 65536, hard limit: 65536

[2019-03-21T10:22:34,743][WARN ][o.e.b.JNANatives         ] These can be adjusted by modifying /etc/security/limits.conf, for example:

        # allow user 'elasticsearch' mlockall

        elasticsearch soft memlock unlimited

        elasticsearch hard memlock unlimited

[2019-03-21T10:22:34,743][WARN ][o.e.b.JNANatives         ] If you are logged in interactively, you will have to re-login for the new limits to take effect.

[2019-03-21T10:22:34,935][INFO ][o.e.n.Node               ] [] initializing ...

[2019-03-21T10:22:35,008][INFO ][o.e.e.NodeEnvironment    ] [_DmjfZJ] using [1] data paths, mounts [[/ (/dev/xvda1)]], net usable_space [47.5gb], net total_space [255.7gb], types [ext4]

[2019-03-21T10:22:35,008][INFO ][o.e.e.NodeEnvironment    ] [_DmjfZJ] heap size [4.9gb], compressed ordinary object pointers [true]

[2019-03-21T10:22:37,177][INFO ][o.e.n.Node               ] node name [_DmjfZJ] derived from node ID [_DmjfZJTTfSYRXbbrtdofw]; set [node.name] to override

[2019-03-21T10:22:37,178][INFO ][o.e.n.Node               ] version[6.2.3], pid[21961], build[c59ff00/2018-03-13T10:06:29.741383Z], OS[Linux/4.4.0-139-generic/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_171/25.171-b11]

[2019-03-21T10:22:37,178][INFO ][o.e.n.Node               ] JVM arguments [-Xms5g, -Xmx5g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch.Y1b0YdlE, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/elasticsearch, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -Xloggc:/var/log/elasticsearch/gc.log, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/etc/elasticsearch]

[2019-03-21T10:22:37,861][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [aggs-matrix-stats]

[2019-03-21T10:22:37,864][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [analysis-common]

[2019-03-21T10:22:37,864][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [ingest-common]

[2019-03-21T10:22:37,864][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [lang-expression]

[2019-03-21T10:22:37,865][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [lang-mustache]

[2019-03-21T10:22:37,865][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [lang-painless]

[2019-03-21T10:22:37,865][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [mapper-extras]

[2019-03-21T10:22:37,866][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [parent-join]

[2019-03-21T10:22:37,866][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [percolator]

[2019-03-21T10:22:37,866][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [rank-eval]

[2019-03-21T10:22:37,866][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [reindex]

[2019-03-21T10:22:37,866][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [repository-url]

[2019-03-21T10:22:37,866][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [transport-netty4]

[2019-03-21T10:22:37,866][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [tribe]

[2019-03-21T10:22:37,867][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] no plugins loaded

[2019-03-21T10:22:42,486][INFO ][o.e.d.DiscoveryModule    ] [_DmjfZJ] using discovery type [zen]

[2019-03-21T10:22:43,120][INFO ][o.e.n.Node               ] initialized

[2019-03-21T10:22:43,120][INFO ][o.e.n.Node               ] [_DmjfZJ] starting ...

[2019-03-21T10:22:43,278][INFO ][o.e.t.TransportService   ] [_DmjfZJ] publish_address {127.0.0.1:9300}, bound_addresses {127.0.0.1:9300}

[2019-03-21T10:22:43,700][WARN ][o.e.b.BootstrapChecks    ] [_DmjfZJ] memory locking requested for elasticsearch process but memory is not locked

[2019-03-21T10:22:46,784][INFO ][o.e.c.s.MasterService    ] [_DmjfZJ] zen-disco-elected-as-master ([0] nodes joined), reason: new_master {_DmjfZJ}{_DmjfZJTTfSYRXbbrtdofw}{xG8ES4z5Sh22HxRgwzKRTw}{127.0.0.1}{127.0.0.1:9300}

[2019-03-21T10:22:46,789][INFO ][o.e.c.s.ClusterApplierService] [_DmjfZJ] new_master {_DmjfZJ}{_DmjfZJTTfSYRXbbrtdofw}{xG8ES4z5Sh22HxRgwzKRTw}{127.0.0.1}{127.0.0.1:9300}, reason: apply cluster state (from master [master {_DmjfZJ}{_DmjfZJTTfSYRXbbrtdofw}{xG8ES4z5Sh22HxRgwzKRTw}{127.0.0.1}{127.0.0.1:9300} committed version [1] source [zen-disco-elected-as-master ([0] nodes joined)]])

[2019-03-21T10:22:46,815][INFO ][o.e.h.n.Netty4HttpServerTransport] [_DmjfZJ] publish_address {127.0.0.1:9200}, bound_addresses {127.0.0.1:9200}

[2019-03-21T10:22:46,815][INFO ][o.e.n.Node               ] [_DmjfZJ] started

[2019-03-21T10:22:57,754][INFO ][o.e.g.GatewayService     ] [_DmjfZJ] recovered [656] indices into cluster_state

[2019-03-21T10:28:12,264][INFO ][o.e.c.r.a.AllocationService] [_DmjfZJ] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[wazuh-alerts-3.x-2018.04.25][3]] ...]).

[2019-03-21T10:35:03,726][INFO ][o.e.n.Node               ] [_DmjfZJ] stopping ...

[2019-03-21T10:35:05,655][INFO ][o.e.n.Node               ] [_DmjfZJ] stopped

[2019-03-21T10:35:05,656][INFO ][o.e.n.Node               ] [_DmjfZJ] closing ...

[2019-03-21T10:35:05,667][INFO ][o.e.n.Node               ] [_DmjfZJ] closed

[2019-03-21T10:35:10,082][WARN ][o.e.b.JNANatives         ] Unable to lock JVM Memory: error=12, reason=Cannot allocate memory

[2019-03-21T10:35:10,084][WARN ][o.e.b.JNANatives         ] This can result in part of the JVM being swapped out.

[2019-03-21T10:35:10,085][WARN ][o.e.b.JNANatives         ] Increase RLIMIT_MEMLOCK, soft limit: 65536, hard limit: 65536

[2019-03-21T10:35:10,085][WARN ][o.e.b.JNANatives         ] These can be adjusted by modifying /etc/security/limits.conf, for example:

        # allow user 'elasticsearch' mlockall

        elasticsearch soft memlock unlimited

        elasticsearch hard memlock unlimited

[2019-03-21T10:35:10,085][WARN ][o.e.b.JNANatives         ] If you are logged in interactively, you will have to re-login for the new limits to take effect.

[2019-03-21T10:35:10,314][INFO ][o.e.n.Node               ] [] initializing ...

[2019-03-21T10:35:10,402][INFO ][o.e.e.NodeEnvironment    ] [_DmjfZJ] using [1] data paths, mounts [[/ (/dev/xvda1)]], net usable_space [47.4gb], net total_space [255.7gb], types [ext4]

[2019-03-21T10:35:10,402][INFO ][o.e.e.NodeEnvironment    ] [_DmjfZJ] heap size [4.9gb], compressed ordinary object pointers [true]

[2019-03-21T10:35:14,505][INFO ][o.e.n.Node               ] node name [_DmjfZJ] derived from node ID [_DmjfZJTTfSYRXbbrtdofw]; set [node.name] to override

[2019-03-21T10:35:14,506][INFO ][o.e.n.Node               ] version[6.2.3], pid[22268], build[c59ff00/2018-03-13T10:06:29.741383Z], OS[Linux/4.4.0-139-generic/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_171/25.171-b11]

[2019-03-21T10:35:14,506][INFO ][o.e.n.Node               ] JVM arguments [-Xms5g, -Xmx5g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch.rVB4IuuO, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/elasticsearch, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -Xloggc:/var/log/elasticsearch/gc.log, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/etc/elasticsearch]

[2019-03-21T10:35:15,300][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [aggs-matrix-stats]

[2019-03-21T10:35:15,300][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [analysis-common]

[2019-03-21T10:35:15,300][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [ingest-common]

[2019-03-21T10:35:15,300][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [lang-expression]

[2019-03-21T10:35:15,300][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [lang-mustache]

[2019-03-21T10:35:15,300][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [lang-painless]

[2019-03-21T10:35:15,300][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [mapper-extras]

[2019-03-21T10:35:15,300][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [parent-join]

[2019-03-21T10:35:15,300][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [percolator]

[2019-03-21T10:35:15,300][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [rank-eval]

[2019-03-21T10:35:15,301][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [reindex]

[2019-03-21T10:35:15,301][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [repository-url]

[2019-03-21T10:35:15,301][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [transport-netty4]

[2019-03-21T10:35:15,301][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [tribe]

[2019-03-21T10:35:15,301][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] no plugins loaded

[2019-03-21T10:35:20,095][INFO ][o.e.d.DiscoveryModule    ] [_DmjfZJ] using discovery type [zen]

[2019-03-21T10:35:20,789][INFO ][o.e.n.Node               ] initialized

[2019-03-21T10:35:20,789][INFO ][o.e.n.Node               ] [_DmjfZJ] starting ...

[2019-03-21T10:35:20,966][INFO ][o.e.t.TransportService   ] [_DmjfZJ] publish_address {10.129.3.46:9300}, bound_addresses {10.129.3.46:9300}

[2019-03-21T10:35:21,327][INFO ][o.e.b.BootstrapChecks    ] [_DmjfZJ] bound or publishing to a non-loopback address, enforcing bootstrap checks

[2019-03-21T10:35:21,330][ERROR][o.e.b.Bootstrap          ] [_DmjfZJ] node validation exception

[1] bootstrap checks failed

[1]: memory locking requested for elasticsearch process but memory is not locked

[2019-03-21T10:35:21,341][INFO ][o.e.n.Node               ] [_DmjfZJ] stopping ...

[2019-03-21T10:35:21,374][INFO ][o.e.n.Node               ] [_DmjfZJ] stopped

[2019-03-21T10:35:21,375][INFO ][o.e.n.Node               ] [_DmjfZJ] closing ...

[2019-03-21T10:35:21,390][INFO ][o.e.n.Node               ] [_DmjfZJ] closed

[2019-03-21T10:42:22,430][WARN ][o.e.b.JNANatives         ] Unable to lock JVM Memory: error=12, reason=Cannot allocate memory

[2019-03-21T10:42:22,432][WARN ][o.e.b.JNANatives         ] This can result in part of the JVM being swapped out.

[2019-03-21T10:42:22,432][WARN ][o.e.b.JNANatives         ] Increase RLIMIT_MEMLOCK, soft limit: 65536, hard limit: 65536

[2019-03-21T10:42:22,432][WARN ][o.e.b.JNANatives         ] These can be adjusted by modifying /etc/security/limits.conf, for example:

        # allow user 'elasticsearch' mlockall

        elasticsearch soft memlock unlimited

        elasticsearch hard memlock unlimited

[2019-03-21T10:42:22,432][WARN ][o.e.b.JNANatives         ] If you are logged in interactively, you will have to re-login for the new limits to take effect.

[2019-03-21T10:42:22,604][INFO ][o.e.n.Node               ] [] initializing ...

[2019-03-21T10:42:22,671][INFO ][o.e.e.NodeEnvironment    ] [_DmjfZJ] using [1] data paths, mounts [[/ (/dev/xvda1)]], net usable_space [47.4gb], net total_space [255.7gb], types [ext4]

[2019-03-21T10:42:22,671][INFO ][o.e.e.NodeEnvironment    ] [_DmjfZJ] heap size [4.9gb], compressed ordinary object pointers [true]

[2019-03-21T10:42:24,697][INFO ][o.e.n.Node               ] node name [_DmjfZJ] derived from node ID [_DmjfZJTTfSYRXbbrtdofw]; set [node.name] to override

[2019-03-21T10:42:24,698][INFO ][o.e.n.Node               ] version[6.2.3], pid[22451], build[c59ff00/2018-03-13T10:06:29.741383Z], OS[Linux/4.4.0-139-generic/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_171/25.171-b11]

[2019-03-21T10:42:24,698][INFO ][o.e.n.Node               ] JVM arguments [-Xms5g, -Xmx5g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch.qWvOclkg, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/elasticsearch, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -Xloggc:/var/log/elasticsearch/gc.log, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/etc/elasticsearch]

[2019-03-21T10:42:25,412][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [aggs-matrix-stats]

[2019-03-21T10:42:25,412][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [analysis-common]

[2019-03-21T10:42:25,412][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [ingest-common]

[2019-03-21T10:42:25,412][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [lang-expression]

[2019-03-21T10:42:25,412][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [lang-mustache]

[2019-03-21T10:42:25,412][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [lang-painless]

[2019-03-21T10:42:25,413][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [mapper-extras]

[2019-03-21T10:42:25,413][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [parent-join]

[2019-03-21T10:42:25,413][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [percolator]

[2019-03-21T10:42:25,413][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [rank-eval]

[2019-03-21T10:42:25,413][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [reindex]

[2019-03-21T10:42:25,413][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [repository-url]

[2019-03-21T10:42:25,413][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [transport-netty4]

[2019-03-21T10:42:25,413][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] loaded module [tribe]

[2019-03-21T10:42:25,413][INFO ][o.e.p.PluginsService     ] [_DmjfZJ] no plugins loaded

[2019-03-21T10:42:29,756][INFO ][o.e.d.DiscoveryModule    ] [_DmjfZJ] using discovery type [zen]

[2019-03-21T10:42:30,364][INFO ][o.e.n.Node               ] initialized

[2019-03-21T10:42:30,365][INFO ][o.e.n.Node               ] [_DmjfZJ] starting ...

[2019-03-21T10:42:30,501][INFO ][o.e.t.TransportService   ] [_DmjfZJ] publish_address {10.129.3.46:9300}, bound_addresses {0.0.0.0:9300}

[2019-03-21T10:42:30,871][INFO ][o.e.b.BootstrapChecks    ] [_DmjfZJ] bound or publishing to a non-loopback address, enforcing bootstrap checks

[2019-03-21T10:42:30,874][ERROR][o.e.b.Bootstrap          ] [_DmjfZJ] node validation exception

[1] bootstrap checks failed

[1]: memory locking requested for elasticsearch process but memory is not locked

[2019-03-21T10:42:30,882][INFO ][o.e.n.Node               ] [_DmjfZJ] stopping ...

[2019-03-21T10:42:30,907][INFO ][o.e.n.Node               ] [_DmjfZJ] stopped

[2019-03-21T10:42:30,907][INFO ][o.e.n.Node               ] [_DmjfZJ] closing ...

[2019-03-21T10:42:30,921][INFO ][o.e.n.Node               ] [_DmjfZJ] closed

Can help me analyze where is the problem?

Regards,

Jacky Qin

[Juan Carlos Rodríguez]

Hi qin.00777,

It seems that you are having a memory lock problem in your environment. You need to enable this option to give the elasticsearch process the permissions to lock the memory that it does not currently have.

This happens on systems that use systemd, where system memory lock limits must be specified via systemd.

The systemd service file (/usr/lib/systemd/system/elasticsearch.service) contains the limits that are applied by default.

To override them, add a file called /etc/systemd/system/elasticsearch.service.d/override.conf (alternatively, you may run systemctl edit elasticsearch which opens the file automatically inside your default editor). Set the following lines on it:

[Service]
LimitMEMLOCK=infinity

Once finished, run the following commands to reload service:

systemctl daemon-reload

systemctl enable elasticsearch.service

systemctl restart elasticsearch.service

Let us know the results.

Best regards,
Juan Carlos

[qin....@gmail.com]

Hi Juan Carlos,

Thank you for your time.After following your instructions,it is already ok.Thank you very much

Best regards,

qin

在 2019年3月21日星期四 UTC+8下午4:09:43，Juan Carlos Rodríguez写道：

<div title="MDH:PGRpdj5IaSBxaW4uMDA3NzcsPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5JdCBzZWVtcyB0aGF0 IHlvdSBhcmUgaGF2aW5nIGEgbWVtb3J5IGxvY2sgcHJvYmxlbSBpbiB5b3VyIGVudmlyb25tZW50 LiBZb3UgbmVlZCB0byBlbmFibGUgdGhpcyBvcHRpb24gdG8gZ2l2ZSB0aGUgPGcgY2xhc3M9Imdy XyBncl8zNyBnci1hbGVydCBncl9zcGVsbCBncl9pbmxpbmVfY2FyZHMgZ3JfcnVuX2FuaW0gQ29u dGV4dHVhbFNwZWxsaW5nIiBpZD0iMzciIGRhdGEtZ3ItaWQ9IjM3Ij5lbGFzdGljc2VhcmNoPC9n PiBwcm9jZXNzIHRoZSBwZXJtaXNzaW9ucyB0byBsb2NrIHRoZSBtZW1vcnkgdGhhdCBpdCBkb2Vz IG5vdCBjdXJyZW50bHkgaGF2ZS48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PlRoaXMgaGFwcGVu cyBvbiBzeXN0ZW1zIHRoYXQgdXNlIGA8ZyBjbGFzcz0iZ3JfIGdyXzMxIGdyLWFsZXJ0IGdyX3Nw ZWxsIGdyX2lubGluZV9jYXJkcyBncl9ydW5fYW5pbSBDb250ZXh0dWFsU3BlbGxpbmcgaW5zLWRl bCBtdWx0aVJlcGxhY2UiIGlkPSIzMSIgZGF0YS1nci1pZD0iMzEiPnN5c3RlbWQ8L2c+YCwgd2hl cmUgc3lzdGVtIG1lbW9yeSBsb2NrIGxpbWl0cyBtdXN0IGJlIHNwZWNpZmllZCB2aWEgYDxnIGNs YXNzPSJncl8gZ3JfMzMgZ3ItYWxlcnQgZ3Jfc3BlbGwgZ3JfaW5saW5lX2NhcmRzIGdyX3J1bl9h bmltIENvbnRleHR1YWxTcGVsbGluZyBpbnMtZGVsIG11bHRpUmVwbGFjZSIgaWQ9IjMzIiBkYXRh LWdyLWlkPSIzMyI+c3lzdGVtZDwvZz5gLjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+VGhlIHN5 c3RlbWQgc2VydmljZSBmaWxlICgvdXNyL2xpYi9zeXN0ZW1kL3N5c3RlbS9lbGFzdGljc2VhcmNo LnNlcnZpY2UpIGNvbnRhaW5zIHRoZSBsaW1pdHMgdGhhdCBhcmUgYXBwbGllZCBieSBkZWZhdWx0 LjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+VG8gb3ZlcnJpZGUgdGhlbSwgYWRkIGEgZmlsZSBj YWxsZWQgYC9ldGMvPGcgY2xhc3M9ImdyXyBncl80MyBnci1hbGVydCBncl9zcGVsbCBncl9pbmxp bmVfY2FyZHMgZ3JfcnVuX2FuaW0gQ29udGV4dHVhbFNwZWxsaW5nIGlucy1kZWwgbXVsdGlSZXBs YWNlIiBpZD0iNDMiIGRhdGEtZ3ItaWQ9IjQzIj5zeXN0ZW1kPC9nPi9zeXN0ZW0vPGcgY2xhc3M9 ImdyXyBncl80NCBnci1hbGVydCBncl9zcGVsbCBncl9pbmxpbmVfY2FyZHMgZ3JfcnVuX2FuaW0g Q29udGV4dHVhbFNwZWxsaW5nIiBpZD0iNDQiIGRhdGEtZ3ItaWQ9IjQ0Ij5lbGFzdGljc2VhcmNo PC9nPi5zZXJ2aWNlLmQvb3ZlcnJpZGUuY29uZmAgKGFsdGVybmF0aXZlbHksIHlvdSBtYXkgcnVu IGA8ZyBjbGFzcz0iZ3JfIGdyXzQ1IGdyLWFsZXJ0IGdyX3NwZWxsIGdyX2lubGluZV9jYXJkcyBn cl9ydW5fYW5pbSBDb250ZXh0dWFsU3BlbGxpbmciIGlkPSI0NSIgZGF0YS1nci1pZD0iNDUiPnN1 ZG88L2c+IDxnIGNsYXNzPSJncl8gZ3JfNDYgZ3ItYWxlcnQgZ3Jfc3BlbGwgZ3JfaW5saW5lX2Nh cmRzIGdyX3J1bl9hbmltIENvbnRleHR1YWxTcGVsbGluZyIgaWQ9IjQ2IiBkYXRhLWdyLWlkPSI0 NiI+c3lzdGVtY3RsPC9nPiBlZGl0IDxnIGNsYXNzPSJncl8gZ3JfNDcgZ3ItYWxlcnQgZ3Jfc3Bl bGwgZ3JfaW5saW5lX2NhcmRzIGdyX3J1bl9hbmltIENvbnRleHR1YWxTcGVsbGluZyIgaWQ9IjQ3 IiBkYXRhLWdyLWlkPSI0NyI+ZWxhc3RpY3NlYXJjaDwvZz5gIHdoaWNoIG9wZW5zIHRoZSBmaWxl IGF1dG9tYXRpY2FsbHkgaW5zaWRlIHlvdXIgZGVmYXVsdCBlZGl0b3IpLiBTZXQgdGhlIGZvbGxv d2luZyBsaW5lcyBvbiBpdDo8L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PmBgYDwvZGl2PjxkaXY+ W1NlcnZpY2VdPC9kaXY+PGRpdj5MaW1pdE1FTUxPQ0s9aW5maW5pdHk8L2Rpdj48ZGl2PmBgYDwv ZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+T25jZSBmaW5pc2hlZCwgcnVuIHRoZSBmb2xsb3dpbmcg Y29tbWFuZHMgdG8gcmVsb2FkIHNlcnZpY2U6PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj48YnI+ PC9kaXY+PGRpdj5gPGcgY2xhc3M9ImdyXyBncl8zOCBnci1hbGVydCBncl9zcGVsbCBncl9pbmxp bmVfY2FyZHMgZ3JfcnVuX2FuaW0gQ29udGV4dHVhbFNwZWxsaW5nIiBpZD0iMzgiIGRhdGEtZ3It aWQ9IjM4Ij5zdWRvPC9nPiA8ZyBjbGFzcz0iZ3JfIGdyXzM5IGdyLWFsZXJ0IGdyX3NwZWxsIGdy X2lubGluZV9jYXJkcyBncl9ydW5fYW5pbSBDb250ZXh0dWFsU3BlbGxpbmciIGlkPSIzOSIgZGF0 YS1nci1pZD0iMzkiPnN5c3RlbWN0bDwvZz4gZGFlbW9uLXJlbG9hZGA8L2Rpdj48ZGl2Pjxicj48 L2Rpdj48ZGl2PmBzdWRvIHN5c3RlbWN0bCBlbmFibGUgZWxhc3RpY3NlYXJjaC5zZXJ2aWNlYDwv ZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+YDxnIGNsYXNzPSJncl8gZ3JfNDAgZ3ItYWxlcnQgZ3Jf c3BlbGwgZ3JfaW5saW5lX2NhcmRzIGdyX3J1bl9hbmltIENvbnRleHR1YWxTcGVsbGluZyIgaWQ9 IjQwIiBkYXRhLWdyLWlkPSI0MCI+c3VkbzwvZz4gPGcgY2xhc3M9ImdyXyBncl80MSBnci