Re: [ info] [input] pausing {re-emitted record}

56 views
Skip to first unread message

Eduardo Silva

unread,
Mar 24, 2021, 10:27:30 PM3/24/21
to Leonid Brandes, Fluent Bit
your rewrite-tag rule should match ONLY the records you want to re-emit. Note that re-emitted records goes through the beginning of the pipeline so they are hitting the rewrite again

On Sat, Mar 20, 2021 at 7:42 AM Leonid Brandes <inte...@gmail.com> wrote:
Hi,

I'm clueless why my re-emitted records are paused in the beginning of the pipeline, i.e. the INPUT section.

The config to reproduce (spared the SERVICE section):
[INPUT]
    name            stdin

[FILTER]
    Name            record_modifier
    Match           *
    Record          env prod

[FILTER]
    Name            rewrite_tag
    Match           *
    Rule            $env ^prod.* valid.prod true
    Emitter_name    re_emitted_valid

[OUTPUT]
    Name            stdout
    match           valid.*

No message reaches stdout. 

The fluent-bit log output with relevant message marked is attached. 

I can also output the metrics:
{
  "input": {
    "stdin.0": {
      "records": 1,
      "bytes": 749
    },
    "re_emitted_valid": {
      "records": 0,
      "bytes": 0
    }
  },
  "filter": {
    "record_modifier.0": {
      "drop_records": 0,
      "add_records": 0
    },
    "rewrite_tag.1": {
      "drop_records": 0,
      "add_records": 0,
      "emit_records": 1
    }
  },
  "output": {
    "stdout.0": {
      "proc_records": 0,
      "proc_bytes": 0,
      "errors": 0,
      "retries": 0,
      "retries_failed": 0
    }
  }
}

--
You received this message because you are subscribed to the Google Groups "Fluent Bit" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fluent-bit+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/fluent-bit/699481b8-1ac2-4833-a523-a9bde822503cn%40googlegroups.com.


--
Reply all
Reply to author
Forward
0 new messages