Wazuh-Indexer Won't start, illegal values more than -1 byte
217 views
Skip to first unread message
Bayu Sangkaya (bayusky.labs)
Sep 20, 2024, 3:28:31 AM9/20/24
to Wazuh | Mailing List
Dear Wazuh Team,
Sorry If my previous message was not complete, I clicked the post button accidentally.
Today, my Wazuh Indexer not getting any alert, when I restarted it it shows error.
[2024-09-20T14:14:19,360][INFO ][o.o.n.Node ] [node-dc] node name [node-dc], node ID [4ngMWBc3SzKMIefE0rKqgQ], cluster name [wazuh-indexer-cluster], roles [ingest, remote_cluster_client, data, master]
[2024-09-20T14:14:21,949][ERROR][o.o.p.c.j.GCMetrics ] [node-dc] MX bean missing: G1 Concurrent GC
[2024-09-20T14:14:24,106][INFO ][o.o.n.p.NeuralSearch ] [node-dc] Registering hybrid query phase searcher with feature flag [plugins.neural_search.hybrid_search_disabled]
[2024-09-20T14:14:24,804][ERROR][o.o.b.Bootstrap ] [node-dc] Exception
java.lang.IllegalArgumentException: Values less than -1 bytes are not supported: -12582912b
at org.opensearch.core.common.unit.ByteSizeValue.<init>(ByteSizeValue.java:78) ~[opensearch-core-2.13.0.jar:2.13.0]
at org.opensearch.knn.index.KNNSettings.parseknnMemoryCircuitBreakerValue(KNNSettings.java:421) ~[?:?]
at org.opensearch.knn.index.KNNSettings$1.lambda$new$0(KNNSettings.java:256) ~[?:?]
at org.opensearch.common.settings.Setting.get(Setting.java:483) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.common.settings.Setting.get(Setting.java:477) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.common.settings.Setting.get(Setting.java:623) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.common.settings.AbstractScopedSettings.get(AbstractScopedSettings.java:792) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.knn.index.KNNSettings.getSettingValue(KNNSettings.java:322) ~[?:?]
at org.opensearch.knn.index.KNNSettings.getCircuitBreakerLimit(KNNSettings.java:381) ~[?:?]
at org.opensearch.knn.index.memory.NativeMemoryCacheManager.initialize(NativeMemoryCacheManager.java:74) ~[?:?]
at org.opensearch.knn.index.memory.NativeMemoryCacheManager.<init>(NativeMemoryCacheManager.java:55) ~[?:?]
at org.opensearch.knn.index.memory.NativeMemoryCacheManager.getInstance(NativeMemoryCacheManager.java:65) ~[?:?]
at org.opensearch.knn.index.KNNCircuitBreaker.initialize(KNNCircuitBreaker.java:58) ~[?:?]
at org.opensearch.knn.plugin.KNNPlugin.createComponents(KNNPlugin.java:202) ~[?:?]
at org.opensearch.node.Node.lambda$new$16(Node.java:877) ~[opensearch-2.13.0.jar:2.13.0]
at java.base/java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:273) ~[?:?]
at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1708) ~[?:?]
at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509) ~[?:?]
at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?]
at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921) ~[?:?]
at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:682) ~[?:?]
at org.opensearch.node.Node.<init>(Node.java:891) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.node.Node.<init>(Node.java:417) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:242) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.Bootstrap.setup(Bootstrap.java:242) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.Bootstrap.init(Bootstrap.java:404) [opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:181) [opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.OpenSearch.execute(OpenSearch.java:172) [opensearch-2.13.0.jar:2.13.0]
at org.opensearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:104) [opensearch-2.13.0.jar:2.13.0]
at org.opensearch.cli.Command.mainWithoutErrorHandling(Command.java:138) [opensearch-cli-2.13.0.jar:2.13.0]
at org.opensearch.cli.Command.main(Command.java:101) [opensearch-cli-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:138) [opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:104) [opensearch-2.13.0.jar:2.13.0]
[2024-09-20T14:14:24,812][ERROR][o.o.b.OpenSearchUncaughtExceptionHandler] [node-dc] uncaught exception in thread [main]
org.opensearch.bootstrap.StartupException: java.lang.IllegalArgumentException: Values less than -1 bytes are not supported: -12582912b
at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:185) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.OpenSearch.execute(OpenSearch.java:172) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:104) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.cli.Command.mainWithoutErrorHandling(Command.java:138) ~[opensearch-cli-2.13.0.jar:2.13.0]
at org.opensearch.cli.Command.main(Command.java:101) ~[opensearch-cli-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:138) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:104) ~[opensearch-2.13.0.jar:2.13.0]
Caused by: java.lang.IllegalArgumentException: Values less than -1 bytes are not supported: -12582912b
at org.opensearch.core.common.unit.ByteSizeValue.<init>(ByteSizeValue.java:78) ~[opensearch-core-2.13.0.jar:2.13.0]
at org.opensearch.knn.index.KNNSettings.parseknnMemoryCircuitBreakerValue(KNNSettings.java:421) ~[?:?]
at org.opensearch.knn.index.KNNSettings$1.lambda$new$0(KNNSettings.java:256) ~[?:?]
at org.opensearch.common.settings.Setting.get(Setting.java:483) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.common.settings.Setting.get(Setting.java:477) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.common.settings.Setting.get(Setting.java:623) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.common.settings.AbstractScopedSettings.get(AbstractScopedSettings.java:792) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.knn.index.KNNSettings.getSettingValue(KNNSettings.java:322) ~[?:?]
at org.opensearch.knn.index.KNNSettings.getCircuitBreakerLimit(KNNSettings.java:381) ~[?:?]
at org.opensearch.knn.index.memory.NativeMemoryCacheManager.initialize(NativeMemoryCacheManager.java:74) ~[?:?]
at org.opensearch.knn.index.memory.NativeMemoryCacheManager.<init>(NativeMemoryCacheManager.java:55) ~[?:?]
at org.opensearch.knn.index.memory.NativeMemoryCacheManager.getInstance(NativeMemoryCacheManager.java:65) ~[?:?]
at org.opensearch.knn.index.KNNCircuitBreaker.initialize(KNNCircuitBreaker.java:58) ~[?:?]
at org.opensearch.knn.plugin.KNNPlugin.createComponents(KNNPlugin.java:202) ~[?:?]
at org.opensearch.node.Node.lambda$new$16(Node.java:877) ~[opensearch-2.13.0.jar:2.13.0]
at java.base/java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:273) ~[?:?]
at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1708) ~[?:?]
at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509) ~[?:?]
at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?]
at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921) ~[?:?]
at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:682) ~[?:?]
at org.opensearch.node.Node.<init>(Node.java:891) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.node.Node.<init>(Node.java:417) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:242) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.Bootstrap.setup(Bootstrap.java:242) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.Bootstrap.init(Bootstrap.java:404) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:181) ~[opensearch-2.13.0.jar:2.13.0]
... 6 more
No changes made, everything usual operation, and suddenly it failed.
And after exhausted googling session, I decided to post in this groups because I don't find any clues or solution.
Glandly accept any kind of clues and help.
[2024-09-20T14:14:19,360][INFO ][o.o.n.Node ] [node-dc] node name [node-dc], node ID [4ngMWBc3SzKMIefE0rKqgQ], cluster name [wazuh-indexer-cluster], roles [ingest, remote_cluster_client, data, master]
[2024-09-20T14:14:21,949][ERROR][o.o.p.c.j.GCMetrics ] [node-dc] MX bean missing: G1 Concurrent GC
[2024-09-20T14:14:24,106][INFO ][o.o.n.p.NeuralSearch ] [node-dc] Registering hybrid query phase searcher with feature flag [plugins.neural_search.hybrid_search_disabled]
[2024-09-20T14:14:24,804][ERROR][o.o.b.Bootstrap ] [node-dc] Exception
java.lang.IllegalArgumentException: Values less than -1 bytes are not supported: -12582912b
at org.opensearch.core.common.unit.ByteSizeValue.<init>(ByteSizeValue.java:78) ~[opensearch-core-2.13.0.jar:2.13.0]
at org.opensearch.knn.index.KNNSettings.parseknnMemoryCircuitBreakerValue(KNNSettings.java:421) ~[?:?]
at org.opensearch.knn.index.KNNSettings$1.lambda$new$0(KNNSettings.java:256) ~[?:?]
at org.opensearch.common.settings.Setting.get(Setting.java:483) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.common.settings.Setting.get(Setting.java:477) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.common.settings.Setting.get(Setting.java:623) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.common.settings.AbstractScopedSettings.get(AbstractScopedSettings.java:792) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.knn.index.KNNSettings.getSettingValue(KNNSettings.java:322) ~[?:?]
at org.opensearch.knn.index.KNNSettings.getCircuitBreakerLimit(KNNSettings.java:381) ~[?:?]
at org.opensearch.knn.index.memory.NativeMemoryCacheManager.initialize(NativeMemoryCacheManager.java:74) ~[?:?]
at org.opensearch.knn.index.memory.NativeMemoryCacheManager.<init>(NativeMemoryCacheManager.java:55) ~[?:?]
at org.opensearch.knn.index.memory.NativeMemoryCacheManager.getInstance(NativeMemoryCacheManager.java:65) ~[?:?]
at org.opensearch.knn.index.KNNCircuitBreaker.initialize(KNNCircuitBreaker.java:58) ~[?:?]
at org.opensearch.knn.plugin.KNNPlugin.createComponents(KNNPlugin.java:202) ~[?:?]
at org.opensearch.node.Node.lambda$new$16(Node.java:877) ~[opensearch-2.13.0.jar:2.13.0]
at java.base/java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:273) ~[?:?]
at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1708) ~[?:?]
at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509) ~[?:?]
at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?]
at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921) ~[?:?]
at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:682) ~[?:?]
at org.opensearch.node.Node.<init>(Node.java:891) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.node.Node.<init>(Node.java:417) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:242) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.Bootstrap.setup(Bootstrap.java:242) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.Bootstrap.init(Bootstrap.java:404) [opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:181) [opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.OpenSearch.execute(OpenSearch.java:172) [opensearch-2.13.0.jar:2.13.0]
at org.opensearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:104) [opensearch-2.13.0.jar:2.13.0]
at org.opensearch.cli.Command.mainWithoutErrorHandling(Command.java:138) [opensearch-cli-2.13.0.jar:2.13.0]
at org.opensearch.cli.Command.main(Command.java:101) [opensearch-cli-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:138) [opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:104) [opensearch-2.13.0.jar:2.13.0]
[2024-09-20T14:14:24,812][ERROR][o.o.b.OpenSearchUncaughtExceptionHandler] [node-dc] uncaught exception in thread [main]
org.opensearch.bootstrap.StartupException: java.lang.IllegalArgumentException: Values less than -1 bytes are not supported: -12582912b
at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:185) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.OpenSearch.execute(OpenSearch.java:172) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:104) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.cli.Command.mainWithoutErrorHandling(Command.java:138) ~[opensearch-cli-2.13.0.jar:2.13.0]
at org.opensearch.cli.Command.main(Command.java:101) ~[opensearch-cli-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:138) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:104) ~[opensearch-2.13.0.jar:2.13.0]
Caused by: java.lang.IllegalArgumentException: Values less than -1 bytes are not supported: -12582912b
at org.opensearch.core.common.unit.ByteSizeValue.<init>(ByteSizeValue.java:78) ~[opensearch-core-2.13.0.jar:2.13.0]
at org.opensearch.knn.index.KNNSettings.parseknnMemoryCircuitBreakerValue(KNNSettings.java:421) ~[?:?]
at org.opensearch.knn.index.KNNSettings$1.lambda$new$0(KNNSettings.java:256) ~[?:?]
at org.opensearch.common.settings.Setting.get(Setting.java:483) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.common.settings.Setting.get(Setting.java:477) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.common.settings.Setting.get(Setting.java:623) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.common.settings.AbstractScopedSettings.get(AbstractScopedSettings.java:792) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.knn.index.KNNSettings.getSettingValue(KNNSettings.java:322) ~[?:?]
at org.opensearch.knn.index.KNNSettings.getCircuitBreakerLimit(KNNSettings.java:381) ~[?:?]
at org.opensearch.knn.index.memory.NativeMemoryCacheManager.initialize(NativeMemoryCacheManager.java:74) ~[?:?]
at org.opensearch.knn.index.memory.NativeMemoryCacheManager.<init>(NativeMemoryCacheManager.java:55) ~[?:?]
at org.opensearch.knn.index.memory.NativeMemoryCacheManager.getInstance(NativeMemoryCacheManager.java:65) ~[?:?]
at org.opensearch.knn.index.KNNCircuitBreaker.initialize(KNNCircuitBreaker.java:58) ~[?:?]
at org.opensearch.knn.plugin.KNNPlugin.createComponents(KNNPlugin.java:202) ~[?:?]
at org.opensearch.node.Node.lambda$new$16(Node.java:877) ~[opensearch-2.13.0.jar:2.13.0]
at java.base/java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:273) ~[?:?]
at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1708) ~[?:?]
at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509) ~[?:?]
at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?]
at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921) ~[?:?]
at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:682) ~[?:?]
at org.opensearch.node.Node.<init>(Node.java:891) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.node.Node.<init>(Node.java:417) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:242) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.Bootstrap.setup(Bootstrap.java:242) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.Bootstrap.init(Bootstrap.java:404) ~[opensearch-2.13.0.jar:2.13.0]
at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:181) ~[opensearch-2.13.0.jar:2.13.0]
... 6 more
No changes made, everything usual operation, and suddenly it failed.
And after exhausted googling session, I decided to post in this groups because I don't find any clues or solution.
Glandly accept any kind of clues and help.
Regards,
Bayu
jorest....@wazuh.com
Sep 23, 2024, 1:03:37 AM9/23/24
to Wazuh | Mailing List
Hello Bayu,
Sorry for replying late.
Can you please share the configurations found under ` /etc/wazuh-indexer/opensearch.yml` and `/etc/wazuh-indexer/jvm.options` with me
best regards,
Brice
Sorry for replying late.
Can you please share the configurations found under ` /etc/wazuh-indexer/opensearch.yml` and `/etc/wazuh-indexer/jvm.options` with me
best regards,
Brice
Reply all
Reply to author
Forward
0 new messages