Trex server crash in ASTF interactive when applied huge latency PPS

[Debanjana Sarkar]

Hi,

I was testing maximum limit of latency PPS in trex ASTF interactive mode and found a trex server crash. Is there any upper limit of latency pps supported ?  I used TRex v2.91 and my drivers are VMXNET3.

Server command used:  sudo ./t-rex-64 -i --astf -c 1
Client command used:  start -f astf/udp_rtp_test2.py -l 100000 -d 10 --pid TF-1

Server crash trace:
WATCHDOG: task 'Trex DP core 1' has not responded for more than 1.0009 seconds - timeout is 1 seconds

*** traceback follows ***

1       0x55a436ca5ee9 ./_t-rex-64(+0x1bbee9) [0x55a436ca5ee9]
2       0x7f2ba468a5d0 /lib64/libpthread.so.0(+0xf5d0) [0x7f2ba468a5d0]
3       0x55a4371bce03 vmxnet3_xmit_pkts + 4115
4       0x55a436c395a9 CCoreEthIF::send_burst(CCorePerPort*, unsigned short, CVirtualIFPerSideStats*) + 153
5       0x55a436c397b0 CCoreEthIF::send_one_pkt(unsigned char, rte_mbuf*) + 144
6       0x55a436c88e41 CFlowGenListPerThread::check_msgs_from_rx() + 321
7       0x55a436c88fe1 CNodeGenerator::handle_maintenance(CFlowGenListPerThread*) + 241
8       0x55a436c8a64c CNodeGenerator::handle_flow_sync(CGenNode*, CFlowGenListPerThread*, bool&) + 92
9       0x55a436c8aaf8 CNodeGenerator::handle_slow_messages(unsigned char, CGenNode*, CFlowGenListPerThread*, bool) + 184
10      0x55a436c38099 int CNodeGenerator::flush_file_realtime<24, false>(double, double, CFlowGenListPerThread*, double&) + 1609
11      0x55a436ea6a0f TrexAstfDpCore::start_scheduler() + 927
12      0x55a436dec149 TrexDpCore::start() + 89
13      0x55a436c7ef63 CFlowGenListPerThread::start(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&, CPreviewMode&) + 115
14      0x55a436c173b5 CGlobalTRex::run_in_core(unsigned char) + 487
15      0x55a436c3acfd ./_t-rex-64(+0x150cfd) [0x55a436c3acfd]
16      0x55a436fdb6a6 eal_thread_loop + 406
17      0x7f2ba4682dd5 /lib64/libpthread.so.0(+0x7dd5) [0x7f2ba4682dd5]
18      0x7f2ba36f7ead clone + 109


*** addr2line information follows ***

??:0
??:0
??:0
??:0
??:0
??:0
??:0
??:0
??:0
??:0
??:0
??:0
??:0
??:0
??:0
??:0
??:0
??:0


./t-rex-64: line 106: 55564 Aborted                 ./_$(basename $0) $INPUT_ARGS $EXTRA_INPUT_ARGS

Thanks in advance.

[hanoh haim]

see this 

https://trex-tgn.cisco.com/trex/doc/trex_faq.html#_running_with_esxi_kvm_i_get_watchdog_crash