EugenX, this line in the logs indicates you're hitting shard limits:
- org.opensearch.common.ValidationException: Validation Failed: 1: this action would add [2] total shards, but this cluster currently has [1000]/[1000] maximum shards open;
Your cluster health is showing yellow status with 22 unassigned shards. Tune your indexer cluster configuration as explained here:
You can get more details by running these indexer API requests in Indexer management > Dev Tools or the command line:
GET _cat/shards
GET _cluster/allocation/explain?pretty
GET <UNASSIGNED_INDEX>/_settings
As you already know, retention policies help in keeping only the most recent indices, so consider re-activating your retention policies.
Also consider increasing the size of your infrastructure. Adding more nodes enhances the indexer capacity:
Let me know what you've got. Thanks.