When testing build, only 7 tests are recognized, all of which are skipped

[Manwei Chan]

I'm following the tutorial and am trying to debug test.py.

I'm using macOS Catalina 10.15.2 and built ns-3.30.1.

When I run ./test.py, the summary line prints: 0 of 7 tests passed (0 passed, 7 skipped, 0 failed, 0 crashed, 0 valgrind errors)

For entire output see attachment

The same happens when I try to run a specific test: bash-3.2$ ./test.py lte-handover-delay

Following prompts I've tried listing all tests with: bash-3.2$ ./waf --run "test-runner --print-test-name-list"

and a whole list of tests appears (see attachment).

I've also attached the output from: bash-3.2$ ./waf configure --enable-examples --enable-tests

which was run beforehand

How do I make test.py run the relevant tests?

Thanks for the help in advance.

[Tom Henderson]

That is strange; I have a Catalina 10.15.2 machine with Xcode command
line tools version 11.3 installed, and it runs all tests for me. My
Python version is 3.7.3.

Please try the following and share the output:

$ ./test.py -s lte-handover-delay -vvv

For me, it shows:

os.environ["PYTHONPATH"] ==
/path/to/ns-allinone-3.30.1/ns-3.30.1/build/bindings/python
os.environ["DYLD_LIBRARY_PATH"] ==
:/path/to/ns-allinone-3.30.1/ns-3.30.1/build/lib
Synchronously execute
/path/to/ns-allinone-3.30.1/ns-3.30.1/build/utils/ns3.30.1-test-runner-debug
--print-test-name-list
Return code = 0
stderr =
Queue lte-handover-delay
Launch utils/ns3.30.1-test-runner-debug --test-name=lte-handover-delay
--stop-on-failure --fullness=QUICK
Synchronously execute
/path/to/ns-allinone-3.30.1/ns-3.30.1/build/utils/ns3.30.1-test-runner-debug
--test-name=lte-handover-delay --stop-on-failure --fullness=QUICK --xml
--tempdir=testpy-output/2020-01-09-16-57-40-CUT
--out=testpy-output/2020-01-09-16-57-40-CUT/lte-handover-delay.xml
Return code = 0
stderr =
returncode = 0
---------- begin standard out ----------

---------- begin standard err ----------

---------- end standard err ----------
PASS: TestSuite lte-handover-delay
1 of 1 tests passed (1 passed, 0 skipped, 0 failed, 0 crashed, 0
valgrind errors)


You can see from this output that calling './test.py -s ...' makes an
underlying call to run the program:

build/utils/ns3.30.1-test-runner-debug --test-name=lte-handover-delay
--stop-on-failure --fullness=QUICK

[Manwei Chan]

Thanks for the tip Tom. I compared your output to mine and was able to find the issue. I was receiving a stderr that stated there was `no such file or directory'. I fiddled with my directory paths and got the test running: 

625 of 635 tests passed (625 passed, 10 skipped, 0 failed, 0 crashed, 0 valgrind errors)

I'll be continuing through the tutorial and hopefully everything else will go smoothly.

Thanks again,

Manwei