How do we track TRex performance Using ElasticSearch, Grafana and Pandas

[Hanoch Haim]

Hi all,

we shared a blog how we track TRex performance here 

https://communities.cisco.com/community/developer/trex/blog/2017/03/23/how-do-we-track-trex-performance-using-elasticsearch-grafana-and-pandas

thanks,

Hanoh

[Andreas Bourges]

Hi Hanoh,

...this looks really impressive. Actually, I was thinking of using grafana/influxdb
to graph our tests during the CPOC in May. I'm thinking of a dashboard showing multiple
timelined aggregates of our streams (per site, per technology v4/v6/MC, ...) and
provide a drill-down like functionality when we observ drops in the aggregates.

The only think I'm still wondering, is
whether we can achieve "near-real-time" data from grafana to visually "see" outages
in our streams (which means an auto-refresh interval <= 5seconds). Do you have any
experience with real-time monitoring of stream-data? Can this be achieved using
grafana (yes, there might be a dependency on influxdb, too...).

If there's some time left before May, I'm gonna have a look at this ;-)

Thanks and regards,

Andreas

[hanoh haim]

Hi Andreas,

Yes it is near real-time.

Graffana and ES works really good together.

All the code are in trex-core repo.

Hanoh

--
You received this message because you are subscribed to the Google Groups "TRex Traffic Generator" group.
To unsubscribe from this group and stop receiving emails from it, send an email to trex-tgn+u...@googlegroups.com.
To post to this group, send email to trex...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/trex-tgn/df32e48a-e433-47f1-b086-fa6b67aab43c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Hanoh

Sent from my iPhone

[tufekc...@gmail.com]

Hi Guys, I have been trying to get ELK to work ZMQ. However, there are many incompatibilities between software version making it impossible to get it to work. I would love to be able to get your code working on the TRex and ELK servers. I do not have much coding experience. It would be great if you can point me to a place showing how one can get ELK running with TRex. Thank you in advance.

[hanoh haim]

Hi, 

There is no relation between ELK and TRex. 

this is for an example how we add Stateless performance to internal ELK server. we are using Python API to interact with TRex and Python API to interact with ELK 

https://github.com/cisco-system-traffic-generator/trex-core/blob/c68eeba86d35ef3cd6531ba30a4d1dd559b744f4/scripts/automation/regression/stateless_tests/stl_benchmark_test.py#L88

thanks

Hanoh

On Thu, Sep 19, 2019 at 3:27 AM <tufekc...@gmail.com> wrote:

Hi Guys, I have been trying to get ELK to work ZMQ. However, there are many incompatibilities between software version making it impossible to get it to work. I would love to be able to get your code working on the TRex and ELK servers. I do not have much coding experience. It would be great if you can point me to a place showing how one can get ELK running with TRex. Thank you in advance.

--
You received this message because you are subscribed to the Google Groups "TRex Traffic Generator" group.
To unsubscribe from this group and stop receiving emails from it, send an email to trex-tgn+u...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/trex-tgn/be60e741-8cdf-4276-8fbe-20bb876b46f2%40googlegroups.com.

[tufekc...@gmail.com]

Thank you for the quick response. So you put the ELK and Graphana on to TRex server. How did it impact the CPU and performance on the TRex? Would you recommend going that route? It would be awesome if you guys take on a task to build something useful for the community. We all have been suffering from easy readability and record-ability of TRex outputs. Thanks again, Onur.