Help on proper approach for test suite runs for lnav in Debian

[Salvatore Bonaccorso]

Hi Tim,

I'm packaging lnav for Debian as you might know and one frequent
problem that I encounter is the instability of the test results. In my
opinion it would be a very good things for regression testing that I
run the test suite.

But in meanwhile I'm disabling quite a lot of tests:

DISABLED_TESTS = \
+ test_config.sh \
+ test_cli.sh \
+ test_mvwattrline \
test_grep_proc.sh \
test_remote.sh \
test_top_status \
test_line_buffer2 \
+ test_listview.sh \
+ test_logfile.sh \
test_line_buffer.sh \
- test_tui.sh
+ test_tui.sh \
+ test_sql.sh \
+ test_sql_indexes.sh \
+ test_sql_json_func.sh \
+ test_sql_str_func.sh \
+ test_text_file.sh \
+ test_cmds.sh

and now preparing 0.13.2 I'm even facting more problems, like:
https://salsa.debian.org/carnil/lnav/-/jobs/8667292
or
https://debusine.debian.net/debian/developers/artifact/2701422/
or
https://debusine.debian.net/debian/developers/artifact/2701424/

I wonder if you have some suggestions on what downstream packages
should actually do here. What do you think?

I would be very happy to have coverage and assurance of test suite
running in Debian (maybe even moved to a autopkgtest to identify
regressions when other packages are updated we depend on).

Am I maybe missing something which would make the runs of the test
suites more stable.

Regards,
Salvatore

[lnav support]

Hi Salvatore,

Thanks for taking the time to package lnav. Unfortunately,
I'm not quite sure what these test failures are about.
I test locally on macos and linux. The CI builds/tests
on the same. But, I don't see failures like this. I'll
try and do some tests with a debian vagrant VM, I guess...

Tim

> --
> You received this message because you are subscribed to the Google Groups "lnav" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to lnav+uns...@googlegroups.com.
> To view this discussion visit https://groups.google.com/d/msgid/lnav/aSqyhRXK3b6i_XPd%40eldamar.lan.

[Salvatore Bonaccorso]

Hi Tim,

On Wed, Dec 03, 2025 at 03:00:36PM +0000, lnav support wrote:
>
> Hi Salvatore,
>
> Thanks for taking the time to package lnav. Unfortunately,
> I'm not quite sure what these test failures are about.
> I test locally on macos and linux. The CI builds/tests
> on the same. But, I don't see failures like this. I'll
> try and do some tests with a debian vagrant VM, I guess...

Thanks a lot for coming back to me, your help is very much
appreciated!

I noticed that many other distributing lnav in the distribution simply
disable all tests. I feel this is not quite optimal, for the last
"experimental" targeting upload though in fact I did the same,
disabling the tests and restricting builds to only 64bit
architectures.

It is odd, and not all test fail reliably. For instance my local build
worked for tests which fail on the buildd infrastructure for Debian,
and even other tests then fail on the debusine.debian.net workflows
(which is different, but helps to test packages in advance).

Regards,
Salvatore