Wazuh not start

20 views

Skip to first unread message

German DiCasas

unread,

Jul 1, 2024, 4:31:14 PM (2 days ago) Jul 1

to Wazuh | Mailing List

Hi team,

I have a error and wazuh dont start "Wazuh dashboard server is not ready yet". The wazuh is 4.7.5-1, all in one install.

over ossec.log I found this:

2024/07/01 16:22:45 wazuh-db: ERROR: Cannot set connection_status for agent 1
2024/07/01 16:22:45 wazuh-db: ERROR: Cannot set connection_status for agent 2
2024/07/01 16:22:45 wazuh-db: ERROR: Cannot set connection_status for agent 3
2024/07/01 16:22:45 wazuh-db: ERROR: Cannot set connection_status for agent 4

...

2024/07/01 16:58:30 wazuh-analysisd: ERROR: dbsync: Bad response from database: Cannot save Syscheck
2024/07/01 17:11:54 wazuh-remoted: WARNING: Queue size is very high. The application may run out of memory.
2024/07/01 17:13:26 agent_control: ERROR: Error querying Wazuh DB to get the agent's 0 information.
2024/07/01 17:13:32 agent_control: ERROR: Unable to connect to socket 'queue/db/wdb'.
2024/07/01 17:13:32 agent_control: ERROR: Unable to connect to socket 'queue/db/wdb'.
2024/07/01 17:13:32 agent_control: ERROR: Unable to connect to socket 'queue/db/wdb'
2024/07/01 17:13:32 agent_control: ERROR: Error querying Wazuh DB to get the agent's 1 information.

Can you let me know what can be the error.Thanks

Regards,

German

Emeka Michael Nzeopara

unread,

Jul 1, 2024, 5:11:38 PM (2 days ago) Jul 1

to Wazuh | Mailing List

Hello German,

May I ask which of the installation techniques you employed in deploying the Wazuh server
Thank you for your time.

German DiCasas

unread,

Jul 1, 2024, 7:13:50 PM (2 days ago) Jul 1

to Wazuh | Mailing List

HI Emeka,

The wazuh was working fine fine some days before. I didnt do the install over this server. How can I know the type of install that you need to know. I only know that is all in one(manager, indexer and dashboard all on same server). I can see the wazuh-install.sh script over the home path.

Also, this service do not start the wazuh-manager, and wazuh-manager.

systemctl restart wazuh-indexer
Job for wazuh-indexer.service failed because the control process exited with error code.
See "systemctl status wazuh-indexer.service" and "journalctl -xeu wazuh-indexer.service" for details.
systemctl restart wazuh-manager
Job for wazuh-manager.service failed because the control process exited with error code.
See "systemctl status wazuh-manager.service" and "journalctl -xeu wazuh-manager.service" for details.

systemctl status wazuh-manager.service
× wazuh-manager.service - Wazuh manager
Loaded: loaded (/lib/systemd/system/wazuh-manager.service; enabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Mon 2024-07-01 20:06:07 -03; 2min 32s ago
Process: 4182 ExecStart=/usr/bin/env /var/ossec/bin/wazuh-control start (code=exited, status=1/FAILURE)
CPU: 13.627s

Jul 01 20:05:49 wazuh env[4209]: 2024/07/01 20:05:49 wazuh-remoted: WARNING: Queue size is very high. The application may run out of memory.
Jul 01 20:05:50 wazuh env[4182]: Starting Wazuh v4.7.5...
Jul 01 20:05:57 wazuh env[4237]: wazuh-apid: Non existent process 2042, removing from /var/ossec/var/run...
Jul 01 20:05:57 wazuh env[4239]: wazuh-apid: Non existent process 2042, removing from /var/ossec/var/run...
Jul 01 20:05:57 wazuh env[4238]: wazuh-apid: Non existent process 2042, removing from /var/ossec/var/run...
Jul 01 20:06:07 wazuh env[4182]: wazuh-apid did not start correctly.
Jul 01 20:06:07 wazuhsystemd[1]: wazuh-manager.service: Control process exited, code=exited, status=1/FAILURE
Jul 01 20:06:07 wazuh systemd[1]: wazuh-manager.service: Failed with result 'exit-code'.
Jul 01 20:06:07 wazuh systemd[1]: Failed to start Wazuh manager.
Jul 01 20:06:07 wazuh systemd[1]: wazuh-manager.service: Consumed 13.627s CPU time.

Let me know if you need some comands to know the last.

systemctl status wazuh-indexer.service
× wazuh-indexer.service - Wazuh-indexer
Loaded: loaded (/lib/systemd/system/wazuh-indexer.service; enabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Mon 2024-07-01 20:05:40 -03; 6min ago
Docs: https://documentation.wazuh.com
Process: 4114 ExecStart=/usr/share/wazuh-indexer/bin/systemd-entrypoint -p ${PID_DIR}/wazuh-indexer.pid --quiet (code=exited, status=1/FAILURE)
Main PID: 4114 (code=exited, status=1/FAILURE)
CPU: 434ms

Jul 01 20:05:40 wazuh systemd-entrypoint[4157]: at java.base/sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:397)
Jul 01 20:05:40 wazuh systemd-entrypoint[4157]: at java.base/java.nio.file.Files.createDirectory(Files.java:700)
Jul 01 20:05:40 wazuh systemd-entrypoint[4157]: at java.base/java.nio.file.TempFileHelper.create(TempFileHelper.java:134)
Jul 01 20:05:40 wazuh systemd-entrypoint[4157]: at java.base/java.nio.file.TempFileHelper.createTempDirectory(TempFileHelper.java:171)
Jul 01 20:05:40 wazuh systemd-entrypoint[4157]: at java.base/java.nio.file.Files.createTempDirectory(Files.java:1017)
Jul 01 20:05:40 wazuh systemd-entrypoint[4157]: at org.opensearch.tools.launchers.Launchers.createTempDirectory(Launchers.java:79)
Jul 01 20:05:40 wazuh systemd-entrypoint[4157]: at org.opensearch.tools.launchers.TempDirectory.main(TempDirectory.java:67)
Jul 01 20:05:40 wazuh systemd[1]: wazuh-indexer.service: Main process exited, code=exited, status=1/FAILURE
Jul 01 20:05:40 wazuh systemd[1]: wazuh-indexer.service: Failed with result 'exit-code'.
Jul 01 20:05:40 wazuh systemd[1]: Failed to start Wazuh-indexer.

Let me know what you think.

Regards,

German

Mauricio Ruben Santillan

unread,

Jul 2, 2024, 3:21:48 PM (13 hours ago) Jul 2

to Wazuh | Mailing List

Hello German,

It is quite difficult to identify the actual cause of the reported issue without the necessary information.

According to what you mention and shared, I can confirm you're having issues in both your Wazuh manager component and in your Wazuh Indexer component. The Wazuh Dashboard simply cannot start without Wazuh Indexer running.

In relation to this, have you performed any changes on your all-in-one recently? Unless your manager is short in resources, it is not normal for it to fail just because.

In relation to your Wazuh manager logs, I'd like to confirm if the error messages you initially shared are being constantly shown or not:

...

Most of the DB-related errors shown could be seen after an upgrade, while the error message:

wazuh-remoted: WARNING: Queue size is very high. The application may run out of memory.

Happens due to a wrong configuration for the remote module in your manager's ossec.conf file. As shown in Wazuh's documentation the queue_size accepts any number between 1 and 262144.

I'm sure you have a higher value set. Make sure to set a proper value. This could easily make Wazuh crash.

Now, have you tried restarting both services?

You can do this by running in your manager's CLI:

systemctl restart wazuh-manager

systemctl restart wazuh-indexer

Have you confirmed your Wazuh server has enough disk space available? You can check this by running in your manager's CLI:

df -h

Have you checked you have enough memory available? For this run:

free -h

It would be very useful to check your managers full log file located in /var/ossec/logs/ossec.log, not just warnings/errors. Context helps a lot when troubleshooting.

Additionally, checking Wazuh's configuration file will help a lot. It is located in /var/ossec/etc/ossec.conf.

Now in relation to your Wazuh Indexer, You should make sure you've set up a proper tunning to your Wazuh Indexer (specially the memory locking).

Also, you should check the Wazuh Indexer log file located in /var/log/wazuh-indexer/wazuh-cluster.log searching for errors/warnings. For this run:

grep -Ei "error|warn" /var/log/wazuh-indexer/wazuh-cluster.log

Additionally, checking Indexer's configuration files will help a lot:

/etc/wazuh-indexer/opensearch.yml

Looking forward to your comments.

German DiCasas

unread,

Jul 2, 2024, 6:44:44 PM (9 hours ago) Jul 2

to Wazuh | Mailing List

HI,

I did a change over ossec.conf over remote module queue_size and was a mistake there. I changed to 262144. Now the services wazuh-manager wazuh-indexer wazuh-dashboard startt well. BUt, I have an error at load url after user login. A added the screenshots. Also I did free up space over disk since df -h give me 100%..

Let me know the inormation you need to proceed.

I did a restart after before remote module change:
cat /var/ossec/logs/ossec.log | grep -i -E "error|warn"

2024/07/02 18:28:57 wazuh-integratord: ERROR: Unable to run integration for custom-telegram -> integrations
2024/07/02 18:28:57 wazuh-integratord: ERROR: While running custom-telegram -> integrations. Output: KeyError: 'win'
2024/07/02 18:28:57 wazuh-integratord: ERROR: Exit status was: 1
2024/07/02 18:35:28 wazuh-db: ERROR: at run_worker(): OS_SendSecureTCP(19): Broken pipe (32)
2024/07/02 18:35:28 wazuh-db: ERROR: at run_worker(): OS_SendSecureTCP(20): Broken pipe (32)
2024/07/02 18:35:28 wazuh-analysisd: ERROR: Error communicating with remoted queue.
2024/07/02 18:35:28 wazuh-analysisd: ERROR: Error communicating with remoted queue.
2024/07/02 18:35:28 wazuh-analysisd: ERROR: (1301): Unable to connect to active response queue.
2024/07/02 18:35:28 wazuh-analysisd: ERROR: (1301): Unable to connect to active response queue.
2024/07/02 18:35:28 wazuh-analysisd: ERROR: Error communicating with remoted queue.
2024/07/02 18:35:28 wazuh-analysisd: ERROR: (1301): Unable to connect to active response queue.
2024/07/02 18:35:28 wazuh-analysisd: ERROR: Error communicating with remoted queue.
2024/07/02 18:35:28 wazuh-analysisd: ERROR: (1301): Unable to connect to active response queue.
2024/07/02 18:35:28 wazuh-analysisd: ERROR: (1301): Unable to connect to active response queue.
2024/07/02 18:35:28 wazuh-analysisd: ERROR: (1301): Unable to connect to active response queue.
2024/07/02 18:35:28 wazuh-analysisd: ERROR: (1301): Unable to connect to active response queue.
2024/07/02 18:35:29 wazuh-db: ERROR: at run_worker(): OS_SendSecureTCP(54): Broken pipe (32)
2024/07/02 18:35:29 wazuh-db: ERROR: at run_worker(): OS_SendSecureTCP(38): Broken pipe (32)
2024/07/02 18:35:29 wazuh-db: ERROR: at run_worker(): OS_SendSecureTCP(35): Broken pipe (32)
2024/07/02 18:35:29 wazuh-db: ERROR: at run_worker(): OS_SendSecureTCP(32): Broken pipe (32)
2024/07/02 18:35:29 wazuh-db: ERROR: at run_worker(): OS_SendSecureTCP(56): Broken pipe (32)
2024/07/02 18:35:29 wazuh-db: ERROR: at run_worker(): OS_SendSecureTCP(29): Broken pipe (32)
2024/07/02 18:35:29 wazuh-db: ERROR: at run_worker(): OS_SendSecureTCP(36): Broken pipe (32)
2024/07/02 18:35:29 wazuh-db: ERROR: at run_worker(): OS_SendSecureTCP(37): Broken pipe (32)
2024/07/02 18:38:12 wazuh-authd: WARNING: Duplicate name 'SRVSQL01', rejecting enrollment. Agent '013' can't be replaced since it is not disconnected.
2024/07/02 19:20:07 wazuh-logcollector: WARNING: Target 'agent' message queue is full (1024). Log lines may be lost.
2024/07/02 19:20:10 wazuh-analysisd: WARNING: Input queue is full.

2024/07/02 19:29:18 wazuh-modulesd:vulnerability-detector: WARNING: (5575): Unavailable vulnerability data for the agent '000' OS. Skipping it.
2024/07/02 19:34:19 wazuh-modulesd:vulnerability-detector: WARNING: (5575): Unavailable vulnerability data for the agent '000' OS. Skipping it.

grep -Ei "error|warn" /var/log/wazuh-indexer/wazuh-cluster.log (full log)

[2024-07-02T18:18:09,880][INFO ][o.o.n.Node ] [node-1] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms8g, -Xmx8g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/opensearch-8965292539039303336, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/wazuh-indexer, -XX:ErrorFile=/var/log/wazuh-indexer/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/wazuh-indexer/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///etc/wazuh-indexer/opensearch-performance-analyzer/opensearch_security.policy, --add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///usr/share/wazuh-indexer/plugins/opendistro-performance-analyzer/pa_config/es_security.policy, -XX:MaxDirectMemorySize=4294967296, -Dopensearch.path.home=/usr/share/wazuh-indexer, -Dopensearch.path.conf=/etc/wazuh-indexer, -Dopensearch.distribution.type=rpm, -Dopensearch.bundled_jdk=true]
[2024-07-02T18:18:15,861][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/roles.yml has insecure file permissions (should be 0600)
[2024-07-02T18:18:15,861][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/internal_users.yml has insecure file permissions (should be 0600)
[2024-07-02T18:18:15,862][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/roles_mapping.ymlOriginal has insecure file permissions (should be 0600)
[2024-07-02T18:18:32,011][WARN ][o.o.s.c.Salt ] [node-1] If you plan to use field masking pls configure compliance salt e1ukloTsQlOgPquJ to be a random string of 16 chars length identical on all nodes
[2024-07-02T18:18:32,081][ERROR][o.o.s.a.s.SinkProvider ] [node-1] Default endpoint could not be created, auditlog will not work properly.
[2024-07-02T18:18:32,082][WARN ][o.o.s.a.r.AuditMessageRouter] [node-1] No default storage available, audit log may not work properly. Please check configuration.
[2024-07-02T18:18:35,582][WARN ][o.o.g.DanglingIndicesState] [node-1] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2024-07-02T18:18:37,704][WARN ][o.o.p.c.s.h.ConfigOverridesClusterSettingHandler] [node-1] Config override setting update called with empty string. Ignoring.
[2024-07-02T18:18:38,037][ERROR][o.o.b.Bootstrap ] [node-1] Exception
[2024-07-02T18:18:38,045][ERROR][o.o.b.OpenSearchUncaughtExceptionHandler] [node-1] uncaught e[2024-07-02T18:18:09,880][INFO ][o.o.n.Node ] [node-1] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms8g, -Xmx8g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/opensearch-8965292539039303336, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/wazuh-indexer, -XX:ErrorFile=/var/log/wazuh-indexer/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/wazuh-indexer/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///etc/wazuh-indexer/opensearch-performance-analyzer/opensearch_security.policy, --add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///usr/share/wazuh-indexer/plugins/opendistro-performance-analyzer/pa_config/es_security.policy, -XX:MaxDirectMemorySize=4294967296, -Dopensearch.path.home=/usr/share/wazuh-indexer, -Dopensearch.path.conf=/etc/wazuh-indexer, -Dopensearch.distribution.type=rpm, -Dopensearch.bundled_jdk=true]

[2024-07-02T18:18:15,861][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/roles.yml has insecure file permissions (should be 0600)
[2024-07-02T18:18:15,861][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/internal_users.yml has insecure file permissions (should be 0600)
[2024-07-02T18:18:15,862][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/roles_mapping.ymlOriginal has insecure file permissions (should be 0600)
[2024-07-02T18:18:32,011][WARN ][o.o.s.c.Salt ] [node-1] If you plan to use field masking pls configure compliance salt e1ukloTsQlOgPquJ to be a random string of 16 chars length identical on all nodes
[2024-07-02T18:18:32,081][ERROR][o.o.s.a.s.SinkProvider ] [node-1] Default endpoint could not be created, auditlog will not work properly.
[2024-07-02T18:18:32,082][WARN ][o.o.s.a.r.AuditMessageRouter] [node-1] No default storage available, audit log may not work properly. Please check configuration.
[2024-07-02T18:18:35,582][WARN ][o.o.g.DanglingIndicesState] [node-1] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2024-07-02T18:18:37,704][WARN ][o.o.p.c.s.h.ConfigOverridesClusterSettingHandler] [node-1] Config override setting update called with empty string. Ignoring.
[2024-07-02T18:18:38,037][ERROR][o.o.b.Bootstrap ] [node-1] Exception
[2024-07-02T18:18:38,045][ERROR][o.o.b.OpenSearchUncaughtExceptionHandler] [node-1] uncaught exception in thread [main]
at org.opensearch.cli.Command.mainWithoutErrorHandling(Command.java:138) ~[opensearch-cli-2.8.0.jar:2.8.0]
[2024-07-02T18:18:38,075][ERROR][o.o.i.i.ManagedIndexCoordinator] [node-1] get managed-index failed: NoShardAvailableActionException[No shard available for [org.opensearch.action.get.MultiGetShardRequest@1906d520]]
[2024-07-02T18:18:38,130][ERROR][o.o.i.i.ManagedIndexCoordinator] [node-1] Failed to get ISM policies with templates: Failed to execute phase [query], all shards failed
[2024-07-02T18:18:38,753][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:38,755][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:38,755][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:38,755][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:38,755][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:38,756][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:38,756][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:38,757][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:38,757][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:38,757][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:39,782][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:39,805][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:39,808][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:39,811][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:42,004][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:42,062][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:42,070][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:42,075][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:44,504][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:44,510][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:44,515][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:44,520][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:47,008][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:47,013][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:47,023][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:47,026][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:49,506][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:49,510][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:49,512][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:49,515][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:52,007][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:52,011][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:52,014][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:52,017][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:55,369][ERROR][o.o.s.a.BackendRegistry ] [node-1] Cannot retrieve roles for User [name=kibanaserver, backend_roles=[], requestedTenant=null] from ldap due to OpenSearchSecurityException[OpenSearchSecurityException[No user kibanaserver found]]; nested: OpenSearchSecurityException[No user kibanaserver found];
[2024-07-02T18:18:55,667][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:18:58,189][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:00,702][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:03,223][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:05,746][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:07,277][ERROR][o.o.s.a.BackendRegistry ] [node-1] Cannot retrieve roles for User [name=admin, backend_roles=[admin], requestedTenant=null] from ldap due to OpenSearchSecurityException[OpenSearchSecurityException[No user admin found]]; nested: OpenSearchSecurityException[No user admin found];
[2024-07-02T18:19:08,272][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:10,789][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:13,304][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:15,821][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:18,331][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:20,841][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:23,465][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:25,973][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:28,485][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:30,999][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:40,213][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:42,730][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:45,247][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:47,758][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:50,270][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:52,781][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:55,293][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:57,806][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:00,587][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:03,104][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:05,620][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:08,134][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:10,867][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:13,379][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:15,892][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:18,407][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:20,922][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:23,436][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:25,950][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:28,464][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:30,978][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:33,492][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:36,252][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:38,766][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:41,278][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:43,788][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:46,297][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:48,808][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:51,370][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:53,884][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:56,398][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:58,908][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:01,417][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:03,930][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:06,443][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:08,956][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:11,470][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:13,983][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:16,493][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:19,005][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:21,636][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:24,146][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:26,659][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:29,210][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:31,725][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:34,247][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:36,760][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:39,324][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:41,883][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:44,398][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:46,908][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:49,426][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:51,937][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:54,570][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:57,081][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:59,591][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:02,103][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:04,616][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:07,128][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:09,643][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:12,155][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:14,668][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:17,205][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:19,717][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:22,235][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:24,750][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:27,264][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:29,776][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:32,290][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:34,965][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:37,483][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:39,994][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:42,645][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:45,157][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:47,669][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:50,181][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:52,690][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:25:01,776][INFO ][o.o.n.Node ] [node-1] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms8g, -Xmx8g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/opensearch-17725655780142828898, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/wazuh-indexer, -XX:ErrorFile=/var/log/wazuh-indexer/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/wazuh-indexer/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///etc/wazuh-indexer/opensearch-performance-analyzer/opensearch_security.policy, --add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///usr/share/wazuh-indexer/plugins/opendistro-performance-analyzer/pa_config/es_security.policy, -XX:MaxDirectMemorySize=4294967296, -Dopensearch.path.home=/usr/share/wazuh-indexer, -Dopensearch.path.conf=/etc/wazuh-indexer, -Dopensearch.distribution.type=rpm, -Dopensearch.bundled_jdk=true]
[2024-07-02T18:25:12,303][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/roles.yml has insecure file permissions (should be 0600)
[2024-07-02T18:25:12,304][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/internal_users.yml has insecure file permissions (should be 0600)
[2024-07-02T18:25:12,304][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/roles_mapping.ymlOriginal has insecure file permissions (should be 0600)
[2024-07-02T18:25:49,776][WARN ][o.o.s.c.Salt ] [node-1] If you plan to use field masking pls configure compliance salt e1ukloTsQlOgPquJ to be a random string of 16 chars length identical on all nodes
[2024-07-02T18:25:49,912][ERROR][o.o.s.a.s.SinkProvider ] [node-1] Default endpoint could not be created, auditlog will not work properly.
[2024-07-02T18:25:49,913][WARN ][o.o.s.a.r.AuditMessageRouter] [node-1] No default storage available, audit log may not work properly. Please check configuration.
[2024-07-02T18:25:53,945][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,950][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,951][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,951][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,951][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,952][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,952][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,952][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,952][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,953][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,954][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,954][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,954][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,955][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,955][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,955][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,957][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,957][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,958][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,958][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,958][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,959][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,959][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,959][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,960][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,960][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,960][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,960][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,961][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,962][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,962][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,962][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,963][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,963][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,963][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:54,540][WARN ][o.o.g.DanglingIndicesState] [node-1] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2024-07-02T18:25:57,302][WARN ][o.o.p.c.s.h.ConfigOverridesClusterSettingHandler] [node-1] Config override setting update called with empty string. Ignoring.
[2024-07-02T18:25:57,777][WARN ][o.o.o.i.ObservabilityIndex] [node-1] message: index [.opensearch-observability/u-DuXJMiSGuvrsXiesAXNA] already exists
[2024-07-02T18:25:57,794][ERROR][o.o.i.i.ManagedIndexCoordinator] [node-1] get managed-index failed: NoShardAvailableActionException[No shard available for [org.opensearch.action.get.MultiGetShardRequest@4d4000f1]]
[2024-07-02T18:25:57,867][ERROR][o.o.i.i.ManagedIndexCoordinator] [node-1] Failed to get ISM policies with templates: Failed to execute phase [query], all shards failed
[2024-07-02T18:25:58,430][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,431][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,431][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,431][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,432][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,432][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,433][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,433][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,433][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,433][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,455][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:25:58,481][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:25:58,485][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:25:58,489][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:00,503][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:00,511][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:00,515][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:00,519][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:03,003][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:03,011][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:03,015][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:03,020][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:05,503][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:05,507][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:05,512][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:05,516][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:06,552][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:06,566][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:08,002][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:08,005][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:08,008][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:08,010][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:10,879][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:10,886][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:10,889][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:10,894][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:15,870][ERROR][o.o.s.a.BackendRegistry ] [node-1] Cannot retrieve roles for User [name=kibanaserver, backend_roles=[], requestedTenant=null] from ldap due to OpenSearchSecurityException[OpenSearchSecurityException[No user kibanaserver found]]; nested: OpenSearchSecurityException[No user kibanaserver found];
[2024-07-02T18:27:15,693][ERROR][o.o.s.a.BackendRegistry ] [node-1] Cannot retrieve roles for User [name=admin, backend_roles=[admin], requestedTenant=null] from ldap due to OpenSearchSecurityException[OpenSearchSecurityException[No user admin found]]; nested: OpenSearchSecurityException[No user admin found];
[2024-07-02T18:27:17,197][WARN ][r.suppressed ] [node-1] path: /.kibana/_doc/config%3A2.8.0, params: {index=.kibana, id=config:2.8.0}
[2024-07-02T18:27:19,276][WARN ][r.suppressed ] [node-1] path: /.kibana/_doc/config%3A2.8.0, params: {index=.kibana, id=config:2.8.0}
[2024-07-02T18:27:20,201][WARN ][r.suppressed ] [node-1] path: /.kibana/_doc/config%3A2.8.0, params: {index=.kibana, id=config:2.8.0}
[2024-07-02T18:27:20,880][WARN ][r.suppressed ] [node-1] path: /.kibana/_doc/config%3A2.8.0, params: {index=.kibana, id=config:2.8.0}
[2024-07-02T18:27:29,334][WARN ][r.suppressed ] [node-1] path: /.kibana/_search, params: {rest_total_hits_as_int=true, size=10000, index=.kibana, from=0, _source=index-pattern.title,namespace,namespaces,type,references,migrationVersion,updated_at,originId,title}
[2024-07-02T18:27:30,451][WARN ][r.suppressed ] [node-1] path: /.kibana/_search, params: {rest_total_hits_as_int=true, size=9999, index=.kibana, from=0, _source=index-pattern.title,index-pattern.fields,namespace,namespaces,type,references,migrationVersion,updated_at,originId,title,fields}
[2024-07-02T18:27:31,443][WARN ][r.suppressed ] [node-1] path: /.kibana/_search, params: {rest_total_hits_as_int=true, size=9999, index=.kibana, from=0, _source=index-pattern.title,index-pattern.fields,namespace,namespaces,type,references,migrationVersion,updated_at,originId,title,fields}
[2024-07-02T18:27:31,991][ERROR][o.o.i.i.ManagedIndexCoordinator] [node-1] Failed to get ISM policies with templates: Failed to execute phase [query], all shards failed
[2024-07-02T18:28:52,920][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:28:55,439][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:28:57,957][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:00,468][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:02,985][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:05,503][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:08,016][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:10,526][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:13,039][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:15,556][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:18,080][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:20,592][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:23,108][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:25,621][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:28,133][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:30,650][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:33,167][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:35,682][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:38,189][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:40,698][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:36:55,549][INFO ][o.o.n.Node ] [node-1] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms8g, -Xmx8g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/opensearch-12147553282873565643, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/wazuh-indexer, -XX:ErrorFile=/var/log/wazuh-indexer/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/wazuh-indexer/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///etc/wazuh-indexer/opensearch-performance-analyzer/opensearch_security.policy, --add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///usr/share/wazuh-indexer/plugins/opendistro-performance-analyzer/pa_config/es_security.policy, -XX:MaxDirectMemorySize=4294967296, -Dopensearch.path.home=/usr/share/wazuh-indexer, -Dopensearch.path.conf=/etc/wazuh-indexer, -Dopensearch.distribution.type=rpm, -Dopensearch.bundled_jdk=true]
[2024-07-02T18:37:00,573][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/roles.yml has insecure file permissions (should be 0600)
[2024-07-02T18:37:00,573][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/internal_users.yml has insecure file permissions (should be 0600)
[2024-07-02T18:37:00,574][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/roles_mapping.ymlOriginal has insecure file permissions (should be 0600)
[2024-07-02T18:37:15,183][WARN ][o.o.s.c.Salt ] [node-1] If you plan to use field masking pls configure compliance salt e1ukloTsQlOgPquJ to be a random string of 16 chars length identical on all nodes
[2024-07-02T18:37:15,273][ERROR][o.o.s.a.s.SinkProvider ] [node-1] Default endpoint could not be created, auditlog will not work properly.
[2024-07-02T18:37:15,274][WARN ][o.o.s.a.r.AuditMessageRouter] [node-1] No default storage available, audit log may not work properly. Please check configuration.
[2024-07-02T18:37:18,914][WARN ][o.o.g.DanglingIndicesState] [node-1] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2024-07-02T18:37:21,489][WARN ][o.o.p.c.s.h.ConfigOverridesClusterSettingHandler] [node-1] Config override setting update called with empty string. Ignoring.
[2024-07-02T18:37:21,846][WARN ][o.o.o.i.ObservabilityIndex] [node-1] message: index [.opensearch-observability/u-DuXJMiSGuvrsXiesAXNA] already exists
[2024-07-02T18:37:21,864][ERROR][o.o.i.i.ManagedIndexCoordinator] [node-1] get managed-index failed: NoShardAvailableActionException[No shard available for [org.opensearch.action.get.MultiGetShardRequest@41164888]]
[2024-07-02T18:37:21,945][ERROR][o.o.i.i.ManagedIndexCoordinator] [node-1] Failed to get ISM policies with templates: Failed to execute phase [query], all shards failed
[2024-07-02T18:37:22,576][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:37:22,577][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:37:22,577][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:37:22,578][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:37:22,588][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:37:22,588][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:37:22,589][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:37:22,589][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:37:22,589][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:37:22,589][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:39:09,491][ERROR][o.o.s.a.BackendRegistry ] [node-1] Cannot retrieve roles for User [name=admin, backend_roles=[admin], requestedTenant=null] from ldap due to OpenSearchSecurityException[OpenSearchSecurityException[No user admin found]]; nested: OpenSearchSecurityException[No user admin found];
[2024-07-02T18:39:50,353][ERROR][o.o.s.a.BackendRegistry ] [node-1] Cannot retrieve roles for User [name=kibanaserver, backend_roles=[], requestedTenant=null] from ldap due to OpenSearchSecurityException[OpenSearchSecurityException[No user kibanaserver found]]; nested: OpenSearchSecurityException[No user kibanaserver found];
[2024-07-02T18:39:51,676][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:39:54,200][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:39:56,713][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:39:59,230][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:01,746][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:04,264][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:06,781][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:09,292][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:11,805][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:14,320][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:16,845][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:19,360][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:21,874][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:24,386][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:26,897][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:29,411][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:31,932][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:34,477][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:36,986][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:39,498][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:42,655][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:45,168][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:48,172][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:50,683][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:53,191][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:55,699][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:58,210][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:41:00,723][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:50:05,547][INFO ][o.o.n.Node ] [node-1] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms8g, -Xmx8g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/opensearch-10625910398293662363, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/wazuh-indexer, -XX:ErrorFile=/var/log/wazuh-indexer/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/wazuh-indexer/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///etc/wazuh-indexer/opensearch-performance-analyzer/opensearch_security.policy, --add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///usr/share/wazuh-indexer/plugins/opendistro-performance-analyzer/pa_config/es_security.policy, -XX:MaxDirectMemorySize=4294967296, -Dopensearch.path.home=/usr/share/wazuh-indexer, -Dopensearch.path.conf=/etc/wazuh-indexer, -Dopensearch.distribution.type=rpm, -Dopensearch.bundled_jdk=true]
[2024-07-02T18:50:13,656][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/roles.yml has insecure file permissions (should be 0600)
[2024-07-02T18:50:13,657][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/internal_users.yml has insecure file permissions (should be 0600)
[2024-07-02T18:50:13,657][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/roles_mapping.ymlOriginal has insecure file permissions (should be 0600)
[2024-07-02T18:51:22,682][WARN ][o.o.s.c.Salt ] [node-1] If you plan to use field masking pls configure compliance salt e1ukloTsQlOgPquJ to be a random string of 16 chars length identical on all nodes
[2024-07-02T18:51:23,277][ERROR][o.o.s.a.s.SinkProvider ] [node-1] Default endpoint could not be created, auditlog will not work properly.
[2024-07-02T18:51:23,278][WARN ][o.o.s.a.r.AuditMessageRouter] [node-1] No default storage available, audit log may not work properly. Please check configuration.
[2024-07-02T18:51:37,636][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,642][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,642][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,643][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,643][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,644][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,644][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,644][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,645][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,645][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,645][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,646][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,646][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,646][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,647][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,647][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,649][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,649][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,650][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,650][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,650][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,651][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,651][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,651][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,651][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,652][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,652][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,652][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,652][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,653][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,653][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,653][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,654][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,654][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,654][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:38,984][WARN ][o.o.g.DanglingIndicesState] [node-1] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2024-07-02T18:51:44,959][WARN ][o.o.p.c.s.h.ConfigOverridesClusterSettingHandler] [node-1] Config override setting update called with empty string. Ignoring.
[2024-07-02T18:51:45,585][ERROR][o.o.i.i.ManagedIndexCoordinator] [node-1] get managed-index failed: NoShardAvailableActionException[No shard available for [org.opensearch.action.get.MultiGetShardRequest@1bd76a6f]]
[2024-07-02T18:51:45,745][ERROR][o.o.i.i.ManagedIndexCoordinator] [node-1] Failed to get ISM policies with templates: Failed to execute phase [query], all shards failed
[2024-07-02T18:51:46,242][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,242][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,242][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,242][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,243][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,243][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,243][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,243][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,243][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,243][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,353][WARN ][o.o.o.i.ObservabilityIndex] [node-1] message: index [.opensearch-observability/u-DuXJMiSGuvrsXiesAXNA] already exists
[2024-07-02T18:51:47,014][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:47,041][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:47,047][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:47,052][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:48,484][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:48,489][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:48,493][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:48,498][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:51,001][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:51,005][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:51,009][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:51,013][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:53,491][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:53,498][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:53,504][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:53,511][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:55,992][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:56,000][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:56,006][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:56,010][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:58,493][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:58,500][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:58,505][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:58,509][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:52:03,189][ERROR][o.o.s.a.BackendRegistry ] [node-1] Cannot retrieve roles for User [name=kibanaserver, backend_roles=[], requestedTenant=null] from ldap due to OpenSearchSecurityException[OpenSearchSecurityException[No user kibanaserver found]]; nested: OpenSearchSecurityException[No user kibanaserver found];
[2024-07-02T18:52:05,167][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:07,757][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:09,694][ERROR][o.o.s.a.BackendRegistry ] [node-1] Cannot retrieve roles for User [name=admin, backend_roles=[admin], requestedTenant=null] from ldap due to OpenSearchSecurityException[OpenSearchSecurityException[No user admin found]]; nested: OpenSearchSecurityException[No user admin found];
[2024-07-02T18:52:10,276][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:14,308][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:16,833][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:21,245][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:23,761][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:26,281][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:28,915][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:31,433][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:34,043][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:36,555][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:39,066][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:41,574][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:44,684][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:47,790][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:50,305][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:53,230][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:55,745][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:58,259][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:00,776][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:03,290][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:05,804][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:08,317][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:10,834][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:13,342][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:15,853][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:18,369][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:20,884][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:23,397][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:25,910][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:28,427][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:30,937][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:33,450][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:35,965][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:38,476][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:40,989][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:43,505][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:46,019][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:48,534][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:51,047][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:53,555][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:56,065][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:58,574][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:01,083][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:03,594][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:06,110][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:08,718][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:11,258][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:13,895][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:16,407][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:18,918][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:21,430][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:23,943][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:26,453][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:28,969][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:31,480][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:33,992][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:36,503][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:39,013][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:41,523][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:44,035][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:46,542][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:49,055][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:51,567][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:54,144][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:56,654][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:59,168][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:01,680][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:04,191][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:06,698][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:09,209][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:11,720][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:14,285][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:16,798][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:19,310][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:21,820][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:24,331][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:26,842][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:29,354][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:31,864][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:34,380][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:36,897][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:39,508][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:42,019][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:44,531][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:47,042][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:49,745][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:52,257][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:54,770][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:57,282][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:59,793][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:02,303][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:04,811][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:07,322][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:09,832][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:12,342][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:14,849][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:17,358][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:19,867][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:22,378][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:24,890][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:27,631][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:30,142][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:32,654][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:35,163][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:37,674][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:38,538][ERROR][o.o.s.s.h.n.SecuritySSLNettyHttpServerTransport] [node-1] Exception during establishing a SSL connection: io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS record: 474554202f5f6361742f696e646963657320485454502f312e310d0a486f73743a206c6f63616c686f73743a393230300d0a557365722d4167656e743a206375726c2f372e38312e300d0a4163636570743a202a2f2a0d0a0d0a
[2024-07-02T18:56:38,543][WARN ][o.o.h.AbstractHttpServerTransport] [node-1] caught exception while handling client http traffic, closing connection Netty4HttpChannel{localAddress=/127.0.0.1:9200, remoteAddress=/127.0.0.1:37336}
[2024-07-02T18:56:40,185][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:42,947][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:45,458][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:47,971][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:50,484][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:52,995][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:55,508][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:58,019][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:00,531][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:03,043][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:05,557][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:08,160][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:10,671][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:13,184][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:15,696][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:18,206][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:20,717][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:23,227][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:25,738][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:28,251][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:30,763][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:33,275][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:35,785][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:38,294][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:40,805][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:43,316][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:45,831][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:48,340][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:58:24,487][ERROR][o.o.s.s.h.n.SecuritySSLNettyHttpServerTransport] [node-1] Exception during establishing a SSL connection: io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS record: 474554202f5f636c75737465722f6865616c74683f70726574747920485454502f312e310d0a486f73743a206c6f63616c686f73743a393230300d0a557365722d4167656e743a206375726c2f372e38312e300d0a4163636570743a202a2f2a0d0a0d0a
[2024-07-02T18:58:24,490][WARN ][o.o.h.AbstractHttpServerTransport] [node-1] caught exception while handling client http traffic, closing connection Netty4HttpChannel{localAddress=/127.0.0.1:9200, remoteAddress=/127.0.0.1:52808}

xception in thread [main]
at org.opensearch.cli.Command.mainWithoutErrorHandling(Command.java:138) ~[opensearch-cli-2.8.0.jar:2.8.0]
[2024-07-02T18:18:38,075][ERROR][o.o.i.i.ManagedIndexCoordinator] [node-1] get managed-index failed: NoShardAvailableActionException[No shard available for [org.opensearch.action.get.MultiGetShardRequest@1906d520]]
[2024-07-02T18:18:38,130][ERROR][o.o.i.i.ManagedIndexCoordinator] [node-1] Failed to get ISM policies with templates: Failed to execute phase [query], all shards failed
[2024-07-02T18:18:38,753][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:38,755][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:38,755][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:38,755][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:38,755][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:38,756][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:38,756][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:38,757][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:38,757][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:38,757][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@4795b39] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:18:39,782][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:39,805][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:39,808][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:39,811][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:42,004][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:42,062][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:42,070][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:42,075][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:44,504][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:44,510][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:44,515][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:44,520][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:47,008][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:47,013][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:47,023][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:47,026][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:49,506][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:49,510][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:49,512][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:49,515][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:52,007][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:52,011][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:52,014][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:52,017][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:18:55,369][ERROR][o.o.s.a.BackendRegistry ] [node-1] Cannot retrieve roles for User [name=kibanaserver, backend_roles=[], requestedTenant=null] from ldap due to OpenSearchSecurityException[OpenSearchSecurityException[No user kibanaserver found]]; nested: OpenSearchSecurityException[No user kibanaserver found];
[2024-07-02T18:18:55,667][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:18:58,189][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:00,702][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:03,223][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:05,746][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:07,277][ERROR][o.o.s.a.BackendRegistry ] [node-1] Cannot retrieve roles for User [name=admin, backend_roles=[admin], requestedTenant=null] from ldap due to OpenSearchSecurityException[OpenSearchSecurityException[No user admin found]]; nested: OpenSearchSecurityException[No user admin found];
[2024-07-02T18:19:08,272][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:10,789][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:13,304][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:15,821][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:18,331][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:20,841][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:23,465][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:25,973][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:28,485][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:30,999][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:40,213][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:42,730][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:45,247][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:47,758][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:50,270][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:52,781][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:55,293][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:19:57,806][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:00,587][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:03,104][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:05,620][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:08,134][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:10,867][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:13,379][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:15,892][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:18,407][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:20,922][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:23,436][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:25,950][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:28,464][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:30,978][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:33,492][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:36,252][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:38,766][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:41,278][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:43,788][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:46,297][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:48,808][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:51,370][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:53,884][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:56,398][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:20:58,908][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:01,417][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:03,930][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:06,443][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:08,956][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:11,470][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:13,983][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:16,493][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:19,005][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:21,636][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:24,146][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:26,659][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:29,210][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:31,725][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:34,247][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:36,760][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:39,324][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:41,883][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:44,398][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:46,908][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:49,426][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:51,937][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:54,570][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:57,081][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:21:59,591][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:02,103][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:04,616][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:07,128][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:09,643][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:12,155][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:14,668][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:17,205][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:19,717][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:22,235][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:24,750][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:27,264][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:29,776][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:32,290][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:34,965][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:37,483][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:39,994][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:42,645][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:45,157][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:47,669][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:50,181][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:22:52,690][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:25:01,776][INFO ][o.o.n.Node ] [node-1] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms8g, -Xmx8g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/opensearch-17725655780142828898, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/wazuh-indexer, -XX:ErrorFile=/var/log/wazuh-indexer/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/wazuh-indexer/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///etc/wazuh-indexer/opensearch-performance-analyzer/opensearch_security.policy, --add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///usr/share/wazuh-indexer/plugins/opendistro-performance-analyzer/pa_config/es_security.policy, -XX:MaxDirectMemorySize=4294967296, -Dopensearch.path.home=/usr/share/wazuh-indexer, -Dopensearch.path.conf=/etc/wazuh-indexer, -Dopensearch.distribution.type=rpm, -Dopensearch.bundled_jdk=true]
[2024-07-02T18:25:12,303][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/roles.yml has insecure file permissions (should be 0600)
[2024-07-02T18:25:12,304][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/internal_users.yml has insecure file permissions (should be 0600)
[2024-07-02T18:25:12,304][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/roles_mapping.ymlOriginal has insecure file permissions (should be 0600)
[2024-07-02T18:25:49,776][WARN ][o.o.s.c.Salt ] [node-1] If you plan to use field masking pls configure compliance salt e1ukloTsQlOgPquJ to be a random string of 16 chars length identical on all nodes
[2024-07-02T18:25:49,912][ERROR][o.o.s.a.s.SinkProvider ] [node-1] Default endpoint could not be created, auditlog will not work properly.
[2024-07-02T18:25:49,913][WARN ][o.o.s.a.r.AuditMessageRouter] [node-1] No default storage available, audit log may not work properly. Please check configuration.
[2024-07-02T18:25:53,945][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,950][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,951][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,951][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,951][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,952][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,952][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,952][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,952][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,953][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,954][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,954][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,954][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,955][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,955][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,955][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,957][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,957][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,958][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,958][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,958][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,959][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,959][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,959][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,960][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,960][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,960][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,960][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,961][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,962][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,962][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,962][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,963][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,963][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:53,963][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:25:54,540][WARN ][o.o.g.DanglingIndicesState] [node-1] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2024-07-02T18:25:57,302][WARN ][o.o.p.c.s.h.ConfigOverridesClusterSettingHandler] [node-1] Config override setting update called with empty string. Ignoring.
[2024-07-02T18:25:57,777][WARN ][o.o.o.i.ObservabilityIndex] [node-1] message: index [.opensearch-observability/u-DuXJMiSGuvrsXiesAXNA] already exists
[2024-07-02T18:25:57,794][ERROR][o.o.i.i.ManagedIndexCoordinator] [node-1] get managed-index failed: NoShardAvailableActionException[No shard available for [org.opensearch.action.get.MultiGetShardRequest@4d4000f1]]
[2024-07-02T18:25:57,867][ERROR][o.o.i.i.ManagedIndexCoordinator] [node-1] Failed to get ISM policies with templates: Failed to execute phase [query], all shards failed
[2024-07-02T18:25:58,430][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,431][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,431][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,431][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,432][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,432][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,433][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,433][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,433][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,433][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@42fb3f06] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:25:58,455][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:25:58,481][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:25:58,485][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:25:58,489][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:00,503][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:00,511][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:00,515][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:00,519][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:03,003][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:03,011][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:03,015][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:03,020][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:05,503][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:05,507][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:05,512][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:05,516][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:06,552][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:06,566][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:08,002][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:08,005][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:08,008][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:08,010][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:10,879][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:10,886][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:10,889][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:10,894][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:26:15,870][ERROR][o.o.s.a.BackendRegistry ] [node-1] Cannot retrieve roles for User [name=kibanaserver, backend_roles=[], requestedTenant=null] from ldap due to OpenSearchSecurityException[OpenSearchSecurityException[No user kibanaserver found]]; nested: OpenSearchSecurityException[No user kibanaserver found];
[2024-07-02T18:27:15,693][ERROR][o.o.s.a.BackendRegistry ] [node-1] Cannot retrieve roles for User [name=admin, backend_roles=[admin], requestedTenant=null] from ldap due to OpenSearchSecurityException[OpenSearchSecurityException[No user admin found]]; nested: OpenSearchSecurityException[No user admin found];
[2024-07-02T18:27:17,197][WARN ][r.suppressed ] [node-1] path: /.kibana/_doc/config%3A2.8.0, params: {index=.kibana, id=config:2.8.0}
[2024-07-02T18:27:19,276][WARN ][r.suppressed ] [node-1] path: /.kibana/_doc/config%3A2.8.0, params: {index=.kibana, id=config:2.8.0}
[2024-07-02T18:27:20,201][WARN ][r.suppressed ] [node-1] path: /.kibana/_doc/config%3A2.8.0, params: {index=.kibana, id=config:2.8.0}
[2024-07-02T18:27:20,880][WARN ][r.suppressed ] [node-1] path: /.kibana/_doc/config%3A2.8.0, params: {index=.kibana, id=config:2.8.0}
[2024-07-02T18:27:29,334][WARN ][r.suppressed ] [node-1] path: /.kibana/_search, params: {rest_total_hits_as_int=true, size=10000, index=.kibana, from=0, _source=index-pattern.title,namespace,namespaces,type,references,migrationVersion,updated_at,originId,title}
[2024-07-02T18:27:30,451][WARN ][r.suppressed ] [node-1] path: /.kibana/_search, params: {rest_total_hits_as_int=true, size=9999, index=.kibana, from=0, _source=index-pattern.title,index-pattern.fields,namespace,namespaces,type,references,migrationVersion,updated_at,originId,title,fields}
[2024-07-02T18:27:31,443][WARN ][r.suppressed ] [node-1] path: /.kibana/_search, params: {rest_total_hits_as_int=true, size=9999, index=.kibana, from=0, _source=index-pattern.title,index-pattern.fields,namespace,namespaces,type,references,migrationVersion,updated_at,originId,title,fields}
[2024-07-02T18:27:31,991][ERROR][o.o.i.i.ManagedIndexCoordinator] [node-1] Failed to get ISM policies with templates: Failed to execute phase [query], all shards failed
[2024-07-02T18:28:52,920][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:28:55,439][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:28:57,957][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:00,468][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:02,985][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:05,503][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:08,016][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:10,526][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:13,039][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:15,556][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:18,080][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:20,592][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:23,108][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:25,621][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:28,133][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:30,650][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:33,167][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:35,682][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:38,189][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:29:40,698][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:36:55,549][INFO ][o.o.n.Node ] [node-1] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms8g, -Xmx8g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/opensearch-12147553282873565643, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/wazuh-indexer, -XX:ErrorFile=/var/log/wazuh-indexer/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/wazuh-indexer/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///etc/wazuh-indexer/opensearch-performance-analyzer/opensearch_security.policy, --add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///usr/share/wazuh-indexer/plugins/opendistro-performance-analyzer/pa_config/es_security.policy, -XX:MaxDirectMemorySize=4294967296, -Dopensearch.path.home=/usr/share/wazuh-indexer, -Dopensearch.path.conf=/etc/wazuh-indexer, -Dopensearch.distribution.type=rpm, -Dopensearch.bundled_jdk=true]
[2024-07-02T18:37:00,573][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/roles.yml has insecure file permissions (should be 0600)
[2024-07-02T18:37:00,573][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/internal_users.yml has insecure file permissions (should be 0600)
[2024-07-02T18:37:00,574][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/roles_mapping.ymlOriginal has insecure file permissions (should be 0600)
[2024-07-02T18:37:15,183][WARN ][o.o.s.c.Salt ] [node-1] If you plan to use field masking pls configure compliance salt e1ukloTsQlOgPquJ to be a random string of 16 chars length identical on all nodes
[2024-07-02T18:37:15,273][ERROR][o.o.s.a.s.SinkProvider ] [node-1] Default endpoint could not be created, auditlog will not work properly.
[2024-07-02T18:37:15,274][WARN ][o.o.s.a.r.AuditMessageRouter] [node-1] No default storage available, audit log may not work properly. Please check configuration.
[2024-07-02T18:37:18,914][WARN ][o.o.g.DanglingIndicesState] [node-1] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2024-07-02T18:37:21,489][WARN ][o.o.p.c.s.h.ConfigOverridesClusterSettingHandler] [node-1] Config override setting update called with empty string. Ignoring.
[2024-07-02T18:37:21,846][WARN ][o.o.o.i.ObservabilityIndex] [node-1] message: index [.opensearch-observability/u-DuXJMiSGuvrsXiesAXNA] already exists
[2024-07-02T18:37:21,864][ERROR][o.o.i.i.ManagedIndexCoordinator] [node-1] get managed-index failed: NoShardAvailableActionException[No shard available for [org.opensearch.action.get.MultiGetShardRequest@41164888]]
[2024-07-02T18:37:21,945][ERROR][o.o.i.i.ManagedIndexCoordinator] [node-1] Failed to get ISM policies with templates: Failed to execute phase [query], all shards failed
[2024-07-02T18:37:22,576][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:37:22,577][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:37:22,577][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:37:22,578][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:37:22,588][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:37:22,588][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:37:22,589][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:37:22,589][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:37:22,589][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:37:22,589][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@74e7051b] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:39:09,491][ERROR][o.o.s.a.BackendRegistry ] [node-1] Cannot retrieve roles for User [name=admin, backend_roles=[admin], requestedTenant=null] from ldap due to OpenSearchSecurityException[OpenSearchSecurityException[No user admin found]]; nested: OpenSearchSecurityException[No user admin found];
[2024-07-02T18:39:50,353][ERROR][o.o.s.a.BackendRegistry ] [node-1] Cannot retrieve roles for User [name=kibanaserver, backend_roles=[], requestedTenant=null] from ldap due to OpenSearchSecurityException[OpenSearchSecurityException[No user kibanaserver found]]; nested: OpenSearchSecurityException[No user kibanaserver found];
[2024-07-02T18:39:51,676][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:39:54,200][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:39:56,713][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:39:59,230][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:01,746][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:04,264][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:06,781][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:09,292][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:11,805][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:14,320][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:16,845][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:19,360][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:21,874][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:24,386][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:26,897][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:29,411][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:31,932][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:34,477][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:36,986][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:39,498][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:42,655][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:45,168][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:48,172][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:50,683][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:53,191][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:55,699][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:40:58,210][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:41:00,723][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:50:05,547][INFO ][o.o.n.Node ] [node-1] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms8g, -Xmx8g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/opensearch-10625910398293662363, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/wazuh-indexer, -XX:ErrorFile=/var/log/wazuh-indexer/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/wazuh-indexer/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///etc/wazuh-indexer/opensearch-performance-analyzer/opensearch_security.policy, --add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///usr/share/wazuh-indexer/plugins/opendistro-performance-analyzer/pa_config/es_security.policy, -XX:MaxDirectMemorySize=4294967296, -Dopensearch.path.home=/usr/share/wazuh-indexer, -Dopensearch.path.conf=/etc/wazuh-indexer, -Dopensearch.distribution.type=rpm, -Dopensearch.bundled_jdk=true]
[2024-07-02T18:50:13,656][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/roles.yml has insecure file permissions (should be 0600)
[2024-07-02T18:50:13,657][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/internal_users.yml has insecure file permissions (should be 0600)
[2024-07-02T18:50:13,657][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/roles_mapping.ymlOriginal has insecure file permissions (should be 0600)
[2024-07-02T18:51:22,682][WARN ][o.o.s.c.Salt ] [node-1] If you plan to use field masking pls configure compliance salt e1ukloTsQlOgPquJ to be a random string of 16 chars length identical on all nodes
[2024-07-02T18:51:23,277][ERROR][o.o.s.a.s.SinkProvider ] [node-1] Default endpoint could not be created, auditlog will not work properly.
[2024-07-02T18:51:23,278][WARN ][o.o.s.a.r.AuditMessageRouter] [node-1] No default storage available, audit log may not work properly. Please check configuration.
[2024-07-02T18:51:37,636][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,642][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,642][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,643][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,643][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,644][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,644][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,644][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,645][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,645][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,645][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,646][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,646][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,646][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,647][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,647][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,649][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,649][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,650][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,650][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,650][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,651][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,651][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,651][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,651][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,652][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,652][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,652][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,652][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,653][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,653][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,653][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,654][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,654][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:37,654][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection
[2024-07-02T18:51:38,984][WARN ][o.o.g.DanglingIndicesState] [node-1] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2024-07-02T18:51:44,959][WARN ][o.o.p.c.s.h.ConfigOverridesClusterSettingHandler] [node-1] Config override setting update called with empty string. Ignoring.
[2024-07-02T18:51:45,585][ERROR][o.o.i.i.ManagedIndexCoordinator] [node-1] get managed-index failed: NoShardAvailableActionException[No shard available for [org.opensearch.action.get.MultiGetShardRequest@1bd76a6f]]
[2024-07-02T18:51:45,745][ERROR][o.o.i.i.ManagedIndexCoordinator] [node-1] Failed to get ISM policies with templates: Failed to execute phase [query], all shards failed
[2024-07-02T18:51:46,242][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,242][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,242][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,242][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,243][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,243][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,243][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,243][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,243][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,243][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure No shard available for [org.opensearch.action.get.MultiGetShardRequest@3a256b32] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security)
[2024-07-02T18:51:46,353][WARN ][o.o.o.i.ObservabilityIndex] [node-1] message: index [.opensearch-observability/u-DuXJMiSGuvrsXiesAXNA] already exists
[2024-07-02T18:51:47,014][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:47,041][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:47,047][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:47,052][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:48,484][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:48,489][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:48,493][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:48,498][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:51,001][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:51,005][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:51,009][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:51,013][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:53,491][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:53,498][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:53,504][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:53,511][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:55,992][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:56,000][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:56,006][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:56,010][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:58,493][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:58,500][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:58,505][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:51:58,509][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin)
[2024-07-02T18:52:03,189][ERROR][o.o.s.a.BackendRegistry ] [node-1] Cannot retrieve roles for User [name=kibanaserver, backend_roles=[], requestedTenant=null] from ldap due to OpenSearchSecurityException[OpenSearchSecurityException[No user kibanaserver found]]; nested: OpenSearchSecurityException[No user kibanaserver found];
[2024-07-02T18:52:05,167][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:07,757][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:09,694][ERROR][o.o.s.a.BackendRegistry ] [node-1] Cannot retrieve roles for User [name=admin, backend_roles=[admin], requestedTenant=null] from ldap due to OpenSearchSecurityException[OpenSearchSecurityException[No user admin found]]; nested: OpenSearchSecurityException[No user admin found];
[2024-07-02T18:52:10,276][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:14,308][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:16,833][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:21,245][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:23,761][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:26,281][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:28,915][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:31,433][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:34,043][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:36,555][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:39,066][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:41,574][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:44,684][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:47,790][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:50,305][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:53,230][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:55,745][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:52:58,259][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:00,776][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:03,290][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:05,804][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:08,317][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:10,834][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:13,342][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:15,853][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:18,369][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:20,884][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:23,397][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:25,910][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:28,427][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:30,937][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:33,450][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:35,965][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:38,476][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:40,989][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:43,505][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:46,019][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:48,534][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:51,047][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:53,555][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:56,065][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:53:58,574][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:01,083][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:03,594][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:06,110][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:08,718][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:11,258][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:13,895][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:16,407][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:18,918][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:21,430][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:23,943][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:26,453][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:28,969][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:31,480][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:33,992][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:36,503][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:39,013][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:41,523][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:44,035][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:46,542][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:49,055][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:51,567][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:54,144][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:56,654][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:54:59,168][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:01,680][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:04,191][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:06,698][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:09,209][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:11,720][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:14,285][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:16,798][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:19,310][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:21,820][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:24,331][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:26,842][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:29,354][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:31,864][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:34,380][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:36,897][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:39,508][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:42,019][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:44,531][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:47,042][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:49,745][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:52,257][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:54,770][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:57,282][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:55:59,793][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:02,303][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:04,811][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:07,322][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:09,832][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:12,342][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:14,849][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:17,358][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:19,867][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:22,378][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:24,890][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:27,631][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:30,142][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:32,654][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:35,163][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:37,674][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:38,538][ERROR][o.o.s.s.h.n.SecuritySSLNettyHttpServerTransport] [node-1] Exception during establishing a SSL connection: io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS record: 474554202f5f6361742f696e646963657320485454502f312e310d0a486f73743a206c6f63616c686f73743a393230300d0a557365722d4167656e743a206375726c2f372e38312e300d0a4163636570743a202a2f2a0d0a0d0a
[2024-07-02T18:56:38,543][WARN ][o.o.h.AbstractHttpServerTransport] [node-1] caught exception while handling client http traffic, closing connection Netty4HttpChannel{localAddress=/127.0.0.1:9200, remoteAddress=/127.0.0.1:37336}
[2024-07-02T18:56:40,185][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:42,947][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:45,458][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:47,971][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:50,484][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:52,995][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:55,508][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:56:58,019][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:00,531][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:03,043][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:05,557][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:08,160][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:10,671][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:13,184][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:15,696][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:18,206][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:20,717][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:23,227][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:25,738][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:28,251][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:30,763][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:33,275][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:35,785][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:38,294][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:40,805][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:43,316][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:45,831][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:57:48,340][WARN ][r.suppressed ] [node-1] path: /.kibana/_count, params: {index=.kibana}
[2024-07-02T18:58:24,487][ERROR][o.o.s.s.h.n.SecuritySSLNettyHttpServerTransport] [node-1] Exception during establishing a SSL connection: io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS record: 474554202f5f636c75737465722f6865616c74683f70726574747920485454502f312e310d0a486f73743a206c6f63616c686f73743a393230300d0a557365722d4167656e743a206375726c2f372e38312e300d0a4163636570743a202a2f2a0d0a0d0a
[2024-07-02T18:58:24,490][WARN ][o.o.h.AbstractHttpServerTransport] [node-1] caught exception while handling client http traffic, closing connection Netty4HttpChannel{localAddress=/127.0.0.1:9200, remoteAddress=/127.0.0.1:52808}

nano /etc/wazuh-indexer/opensearch.yml

network.host: "127.0.0.1"
node.name: "node-1"
cluster.initial_master_nodes:
- "node-1"
cluster.name: "wazuh-cluster"

node.max_local_storage_nodes: "3"
path.data: /var/lib/wazuh-indexer
path.logs: /var/log/wazuh-indexer

plugins.security.ssl.http.pemcert_filepath: /etc/wazuh-indexer/certs/wazuh-indexer.pem
plugins.security.ssl.http.pemkey_filepath: /etc/wazuh-indexer/certs/wazuh-indexer-key.pem
plugins.security.ssl.http.pemtrustedcas_filepath: /etc/wazuh-indexer/certs/root-ca.pem
plugins.security.ssl.transport.pemcert_filepath: /etc/wazuh-indexer/certs/wazuh-indexer.pem
plugins.security.ssl.transport.pemkey_filepath: /etc/wazuh-indexer/certs/wazuh-indexer-key.pem
plugins.security.ssl.transport.pemtrustedcas_filepath: /etc/wazuh-indexer/certs/root-ca.pem
plugins.security.ssl.http.enabled: true
plugins.security.ssl.transport.enforce_hostname_verification: false
plugins.security.ssl.transport.resolve_hostname: false
plugins.security.ssl.http.enabled_ciphers:
- "TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256"
- "TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384"
- "TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256"
- "TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384"
plugins.security.ssl.http.enabled_protocols:
- "TLSv1.2"
plugins.security.authcz.admin_dn:
- "CN=admin,OU=Wazuh,O=Wazuh,L=California,C=US"
plugins.security.check_snapshot_restore_write_privileges: true
plugins.security.enable_snapshot_restore_privilege: true
plugins.security.nodes_dn:
- "CN=indexer,OU=Wazuh,O=Wazuh,L=California,C=US"
plugins.security.restapi.roles_enabled:
- "all_access"
- "security_rest_api_access"

plugins.security.system_indices.enabled: true
plugins.security.system_indices.indices: [".opendistro-alerting-config", ".opendistro-alerting-alert*", ".opendistro-anomaly-results*", ".opendistro-anomaly-detector*", ".opendistro-anomaly-checkp>

### Option to allow Filebeat-oss 7.10.2 to work ###
compatibility.override_main_response_version: true

-Let me know if you need more information, thanks

error-1-1.png

error-1-2.png

error-1.png

Reply all

Reply to author

Forward

0 new messages