linux build error v2

[Peter Marks]

I'm trying to build v2 on Linux Mint 22 (based on Ubuntu).

v1 builds just fine. Hopefully obvious to someone, looks like something to do with opus.

dnn/lossgen_data.c
dnn/lossgen_data.h
Updating build configuration files, please wait....
./autogen.sh: 16: autoreconf: not found
make[2]: *** [CMakeFiles/build_opus.dir/build.make:92: build_opus-prefix/src/build_opus-stamp/build_opus-configure] Error 127
make[2]: Leaving directory '/home/marksp/Documents/freedv-gui-2.0.0-20241018/build_linux'
make[1]: *** [CMakeFiles/Makefile2:334: CMakeFiles/build_opus.dir/all] Error 2
make[1]: Leaving directory '/home/marksp/Documents/freedv-gui-2.0.0-20241018/build_linux'
make: *** [Makefile:156: all] Error 2
marksp@latitude:~/Documents/freedv-gui-2.0.0-20241018$ 

Any hints would be most welcome.

73

Peter

VK3TPM

[Peter Marks]

Ignore me. I should learn to read error messages. Needed to install autoconf.

[Peter Marks]

Hmm, no, still not quiet getting there:

m4/as-gcc-inline-assembly.m4:12: AS_GCC_INLINE_ASSEMBLY is expanded from...
lib/m4sugar/m4sh.m4:699: AS_IF is expanded from...
configure.ac:227: the top level
configure.ac:502: warning: The macro `AC_HELP_STRING' is obsolete.
configure.ac:502: You should run autoupdate.
./lib/autoconf/general.m4:204: AC_HELP_STRING is expanded from...
configure.ac:428: OPUS_PATH_NE10 is expanded from...
lib/m4sugar/m4sh.m4:699: AS_IF is expanded from...
lib/m4sugar/m4sh.m4:594: AS_CASE is expanded from...
lib/m4sugar/m4sh.m4:699: AS_IF is expanded from...
configure.ac:502: the top level
configure.ac:38: error: possibly undefined macro: AM_PROG_LIBTOOL
      If this token and others are legitimate, please use m4_pattern_allow.
      See the Autoconf documentation.
autoreconf: error: /usr/bin/autoconf failed with exit status: 1

make[2]: *** [CMakeFiles/build_opus.dir/build.make:92: build_opus-prefix/src/build_opus-stamp/build_opus-configure] Error 1

make[2]: Leaving directory '/home/marksp/Documents/freedv-gui-2.0.0-20241018/build_linux'
make[1]: *** [CMakeFiles/Makefile2:334: CMakeFiles/build_opus.dir/all] Error 2
make[1]: Leaving directory '/home/marksp/Documents/freedv-gui-2.0.0-20241018/build_linux'
make: *** [Makefile:156: all] Error 2

[Peter Marks]

More context:

dnn/dred_rdovae_enc_data.c
dnn/dred_rdovae_dec_data.c

dnn/lossgen_data.c
dnn/lossgen_data.h
Updating build configuration files, please wait....

configure.ac:38: warning: macro 'AM_PROG_LIBTOOL' not found in library
configure.ac:37: warning: The macro `AC_MINGW32' is obsolete.
configure.ac:37: You should run autoupdate.
./lib/autoconf/specific.m4:347: AC_MINGW32 is expanded from...
configure.ac:37: the top level
configure.ac:41: warning: The macro `AC_PROG_CC_C99' is obsolete.
configure.ac:41: You should run autoupdate.
./lib/autoconf/c.m4:1659: AC_PROG_CC_C99 is expanded from...
configure.ac:41: the top level
configure.ac:199: warning: The macro `AC_WARN' is obsolete.
configure.ac:199: You should run autoupdate.
./lib/autoconf/oldnames.m4:33: AC_WARN is expanded from...

lib/m4sugar/m4sh.m4:699: AS_IF is expanded from...

./lib/autoconf/general.m4:1534: AC_ARG_ENABLE is expanded from...
configure.ac:199: the top level
configure.ac:227: warning: The macro `AC_TRY_COMPILE' is obsolete.
configure.ac:227: You should run autoupdate.
./lib/autoconf/general.m4:2847: AC_TRY_COMPILE is expanded from...

m4/as-gcc-inline-assembly.m4:12: AS_GCC_INLINE_ASSEMBLY is expanded from...
lib/m4sugar/m4sh.m4:699: AS_IF is expanded from...
configure.ac:227: the top level
configure.ac:502: warning: The macro `AC_HELP_STRING' is obsolete.
configure.ac:502: You should run autoupdate.
./lib/autoconf/general.m4:204: AC_HELP_STRING is expanded from...
configure.ac:428: OPUS_PATH_NE10 is expanded from...
lib/m4sugar/m4sh.m4:699: AS_IF is expanded from...
lib/m4sugar/m4sh.m4:594: AS_CASE is expanded from...
lib/m4sugar/m4sh.m4:699: AS_IF is expanded from...
configure.ac:502: the top level
configure.ac:38: error: possibly undefined macro: AM_PROG_LIBTOOL
      If this token and others are legitimate, please use m4_pattern_allow.
      See the Autoconf documentation.
autoreconf: error: /usr/bin/autoconf failed with exit status: 1
make[2]: *** [CMakeFiles/build_opus.dir/build.make:92: build_opus-prefix/src/build_opus-stamp/build_opus-configure] Error 1
make[2]: Leaving directory '/home/marksp/Documents/freedv-gui-2.0.0-20241018/build_linux'
make[1]: *** [CMakeFiles/Makefile2:334: CMakeFiles/build_opus.dir/all] Error 2
make[1]: Leaving directory '/home/marksp/Documents/freedv-gui-2.0.0-20241018/build_linux'
make: *** [Makefile:156: all] Error 2

[Mooneer Salem]

Sounds like you need to install libtool as well. The rest look like warnings that can be ignored.

-Mooneer K6AQ

--
You received this message because you are subscribed to the Google Groups "digitalvoice" group.
To unsubscribe from this group and stop receiving emails from it, send an email to digitalvoice...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/digitalvoice/5cd87deb-bac7-40c5-8ebb-829e45b4e1c5n%40googlegroups.com.

[Peter Marks]

Thank you! Building in progress now.

Suggest adding libtool and autoconf to the README dependencies for linux.

[Peter Marks]

More deps. Sorry if this is in the notes. python3-numpy

[Peter Marks]

python3-numpy-dev

It builds! and runs.

but when I try RADE:

ig_close(1559): 0x78341000401c rs->comm_state==0?=0
   3:rig.c(1563):rig_close returning(0)
   3:icom.c(736):icom_cleanup entered
   3:icom.c(761):icom_cleanup returning(0)
model file: TBD
import_array returned: 0
ModuleNotFoundError: No module named 'radae_txe'
Error: importing radae_txe

I'm sure it's my fault for not reading more. I guess I have to train the model.

[Mooneer Salem]

There are a few more things you'll need to do. See https://github.com/drowe67/freedv-gui/blob/v2.0-dev/README.md#running-rade-mode-on-linux for more info.

-Mooneer K6AQ

To view this discussion visit https://groups.google.com/d/msgid/digitalvoice/09e71aad-6c01-4a93-9dee-6f9697c93e06n%40googlegroups.com.

[Peter Marks]

Thanks so much for your help Mooneer. I'm getting close but will try the windows version for a while.

Sorry to waste your time.

Rs: 33.33 Rs': 50.00 Ts': 0.020 Nsmf: 120 Ns:   4 Nc:  30 M: 160 Ncp: 32
/home/marksp/Documents/freedv-gui-2.0.0-20241018/build_linux/rade_src/radae_txe.py:64: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
  checkpoint = torch.load(model_name, map_location='cpu')
Traceback (most recent call last):
  File "/home/marksp/Documents/freedv-gui-2.0.0-20241018/build_linux/rade_src/radae_txe.py", line 64, in __init__
    checkpoint = torch.load(model_name, map_location='cpu')
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/marksp/Documents/freedv-gui-2.0.0-20241018/rade-venv/lib/python3.12/site-packages/torch/serialization.py", line 1319, in load
    with _open_file_like(f, "rb") as opened_file:
         ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/marksp/Documents/freedv-gui-2.0.0-20241018/rade-venv/lib/python3.12/site-packages/torch/serialization.py", line 659, in _open_file_like
    return _open_file(name_or_buffer, mode)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/marksp/Documents/freedv-gui-2.0.0-20241018/rade-venv/lib/python3.12/site-packages/torch/serialization.py", line 640, in __init__
    super().__init__(open(name, mode))
                     ^^^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: 'model19_check3/checkpoints/checkpoint_epoch_100.pth'
Error: Creating instance of class radae_tx

[Barry Jackson]

>>>>>>> <https://groups.google.com/d/msgid/digitalvoice/5cd87deb-bac7-40c5-8ebb-829e45b4e1c5n%40googlegroups.com?utm_medium=email&utm_source=footer>
>>>>>>> .

>>>>>>>
>>>>>> --
>>> You received this message because you are subscribed to the Google Groups
>>> "digitalvoice" group.
>>> To unsubscribe from this group and stop receiving emails from it, send an
>>> email to digitalvoice...@googlegroups.com.
>>>
>> To view this discussion visit

>>> https://groups.google.com/d/msgid/digitalvoice/09e71aad-6c01-4a93-9dee-6f9697c93e06n%40googlegroups.com
>>> <https://groups.google.com/d/msgid/digitalvoice/09e71aad-6c01-4a93-9dee-6f9697c93e06n%40googlegroups.com?utm_medium=email&utm_source=footer>
>>> .
>>>
>>
>

Hi Peter,
You can use my script here to install in Mint, just follow the instructions:
https://github.com/barjac/freedv-rade-build
Barry
G4MKT

[Peter Marks]

Barry,

That's fantastic. The build went through flawlessly on Linux Mint 22 and I'm up and running.

Great work, thanks for sharing.

Peter

[Rick, W7IMM]

Peter,

I made my first attempt at building it on Linux simply following the steps in the read-me file.

I'm using KDE NEON running on Ubuntu 22.04 and after the install, the version indicated 1.9.10-Devel instead of 2.0.0-Devel

And RADE is not one of the choices.  Is there something I "sorely" missed?

Thanks,

Rick/W7IMM

[Peter Marks]

Rick,

In the end I used this script which checked out the code and did the build: https://github.com/barjac/freedv-rade-build

That's how I got it building with RADE.

I have some notes on my experience here: https://blog.marxy.org/2024/11/machine-learning-comes-to-amateur-radio.html 

73

[Rick, W7IMM]

Peter, 

Thanks so much for the quick reply!!

I have been using OpenSuSE Linux since v9.3 When RedHat stopped providing a CD in a boxed version and started the Fedora Project!  (around 2001 or so) ....I'm currently using Leap 15.6 on my desktop

I recently installed KDE NEON on a MID 2012 MacBook Pro (Core i7)  mainly because it actually is the latest KDE Plasma built on Ubuntu 22.04 LTS (Sort of like Kubuntu I guess, except it is packaged by the KDE developers)

I switched because there appears to be FAR MORE amateur radio packages for Ubuntu than any other distro....and they all install/run on NEON.

There is a German amateur that has built OpenSuSE RPMs for FreeDV but the latest one appears to be 1.8.x etc.  He hasn't built a current one in quite a while and hasn't responded to requests.  I would love to get him on here to discuss FreeDV, but it appears that he's a busy guy!

Ultimately I just want to get it working on either my MAC Book running KDE Neon and/or my desktop. 

 I've been thinking about switching the desktop to NEON also.  (The other thing that has me wanting to switch is that PROTON (Mail/Calendar/VPN/etc) fully supports (Debian) Ubuntu but NOT OpenSuSE.  There's a few dependencies that are simply not there to use the Proton Mail app or even the Proton mail Bridge !

I have been using FreeDV 2.0.0-xxx on my early 2015 MacBook Pro (Monterey)  and it works quite well! (I have a Winblows laptop too)

I am also trying to collect a large group in the Pacific NW incl BC to use RADE on 40 and 75m on a regular basis.

Anyway, I'll have a look at the suggestions you mentioned.   I must've made a build error.  I am real Linux novice (even though I have used it for many years, I have always used package repos for software)

Thanks again!

73/Rick

W7IMM

[Peter Marks]

Rick, that script installed all the things needed for a build on my machine which runs Linux Mint Cinnamon. It's based on Ubuntu. I'm not sure why using KDE on the desktop would be a problem. If you could run the script and show the first build errors you're getting that might help to figure out what's going on. It's quite a big build so don't try posting the whole output.

Good luck.

Peter

[Rick Kunath]

Rick,

You probably don't need the info now since you aren't running OpenSuse
any more. But I have successfully built it, including RADE on
Tumbleweed. The Python part is a bit different, but it builds and runs
well. And I needed a few distro packages, it did not like a few of the
static packages provided with the git clone.

Also remember that the venv of Python can be affected by other veenv
using applications. So it may get shutr down unknowingly by you by
another application. this won't be an issue when the code is pulled into C.

I did write the package maintainer of the OpenSuse Build Service repo
(private repo hosted by Suse) but I never got a reply either. But now
that i know what is what source building is pretty trivial.

Rick Kunath, K9AO

[Rick, W7IMM]

Rick,

Thanks for that info!

I had TW on my Macbook Pro a few times but in every case, after a month or so of updates, there would be a kernel update or "something"

an update that would either kill the Boadcomm BCM4331 wireless driver or it would kill Network Manager and remove internet access! 

 I tried several things to fix it but it was quicker to just re-install the entire mess. and it would work for a little while then it would do it all over again.

I know the "old" wifi "radio"  in the (mid 2012) Macbook should be replaced with something a little newer  but it might not be worth it.

I just got tired of re-installing TW (and Leap for that matter) on it.  Leap would last a little longer but eventually some update would kill the wifi too.

I don't know if the kernel boys will eventually drop support for the older Broadcomm devices or not.  I really wanted to keep using the the MAC because it's got a Core i7 processor in it and 16gb RAM.  It otherwise runs any of the Linux's quite well!  KDE NEON works REALLY well.

On my Desktop, I would still like to try TW and might just get back to you for help getting the release version of FreeDV with RADE working on it.

Did you actually build an RPM for TW or did you just build it from source?

I am really hoping that Mooneer or someone else will see the value in creating a "RUN" version of FreeDV will will run natively on any distro of Linux without having to hunt for missing dependencies.

The SDR PLAY SDRConnect app (or SDRConnect.dmg)  seems to run on any version of Linux (including the ras-pi )  or the MAC and doesn't appear to be required to be fully "installed" (whatever that means!!)  https://www.sdrplay.com/sdrconnect/

I do not know how much effort is required to produce one of these types of applications, but I think having it able to run on any platform might get it out there for more people. And yes I know OpenSuSE is not the go-to Linux for most Linux  people.....I have NEVER like any of the Ubuntu/Clone desktop environments except KDE.  Hence my interest in NEON or even Kubuntu for that matter.  I like NEON because it has been specifically packaged by the KDE team.

I am guessing that the eventual intention is to have a "box" for FreeDV/RADE etc that is  not unlike the EZDV so  that anyone canconnect to  current radios and hopefully for new manufacture radios,  a "built-in" "DV" mode included with all the other modes.  Not sure how open ICOM, KW, Yae and others would be to that......

Cheers,

Rick

W7IMM

[Rick Kunath]

My comments inline Rick...


> <Snipped>

> I had TW on my Macbook Pro a few times but in every case, after a
> month or so of updates, there would be a kernel update or "something"
> an update that would either kill the Boadcomm BCM4331 wireless driver
> or it would kill Network Manager and remove internet access!

Were you using Wicked or the new now default Network Manager?

>
>  I tried several things to fix it but it was quicker to just
> re-install the entire mess. and it would work for a little while then
> it would do it all over again.

A simple snapshot rollback would have been so much easier. That's why TW
uses a BTRFS file system.

>
> I know the "old" wifi "radio"  in the (mid 2012) Macbook should be
> replaced with something a little newer  but it might not be worth it.
>
> I just got tired of re-installing TW (and Leap for that matter) on
> it.  Leap would last a little longer but eventually some update would
> kill the wifi too.

There should not have been the issues that you are having. Broadcom is
well supported. Did you ever file a bug report?

>
>
> On my Desktop, I would still like to try TW and might just get back to
> you for help getting the release version of FreeDV with RADE working
> on it.

Sure, happy to help.

>
> Did you actually build an RPM for TW or did you just build it from source?

I source built FreeDV.

>
> I am really hoping that Mooneer or someone else will see the value in
> creating a "RUN" version of FreeDV will will run natively on any
> distro of Linux without having to hunt for missing dependencies.

I'm not a fan of these containers myself. They do not have full access
to the OS at the same level that a native package does, whether rpm or
source installed. Dependencies are one of the good things about Linux.
If you use a recent distro or a non- LTS distro that will not hold on to
ancient libs, it really should not be an issue.

>
> I do not know how much effort is required to produce one of these
> types of applications, but I think having it able to run on any
> platform might get it out there for more people. And yes I know
> OpenSuSE is not the go-to Linux for most Linux people.....I have NEVER
> like any of the Ubuntu/Clone desktop environments except KDE.  Hence
> my interest in NEON or even Kubuntu for that matter.  I like NEON
> because it has been specifically packaged by the KDE team.

I'm a KDE Plasma 6 guy myself, but you can use any DE on TW. I expect
standard Linux behavior and structure, that's why I like TW. Others do
not follow this precept and are simply messed with or dictate too much
about what I can use. As to any platform, you can do some
cross-compiling but a run anywhere app is difficult to do, especially if
it is a real-time app.You want to leverage the full capabilities of the
OS, so generalizing it is not always a good idea.

It may be that some of the issues folks are having are with the Python
venv and either getting that going or having it working and then
inadvertently running another Python app that changes the venv to
something else.

Rick Kunath, K9AO

[Rick, W7IMM]

On Saturday, January 4, 2025 at 2:59:33 PM UTC-8 Rick Kunath wrote:

Were you using Wicked or the new now default Network Manager?

I have always used Network Manager.  

A simple snapshot rollback would have been so much easier. That's why TW
uses a BTRFS file system.

I am aware of the snapshot rollback but have never used it.  I guess I should edumacate myself about it!!

 

There should not have been the issues that you are having. Broadcom is
well supported. Did you ever file a bug report?

I did not.  I know Broadcom has been well supported for many years but when it happened twice I started to wonder!

 

 

Sure, happy to help.


I source built FreeDV.

Apologies.....you said that in your first comments and I realized it after I pressed "SEND"!!

I'm not a fan of these containers myself. They do not have full access
to the OS at the same level that a native package does, whether rpm or
source installed. Dependencies are one of the good things about Linux.
If you use a recent distro or a non- LTS distro that will not hold on to
ancient libs, it really should not be an issue.

I think Mooneer also said as much.

I have always been a little afraid of installing from source because I always thought the installation would "break" on the first distro update, especially if a set of libs or major package dependencies were updated to  newer versions.

As I learn more, I've discovered that maybe that's not entirely true.......

 

I'm a KDE Plasma 6 guy myself, but you can use any DE on TW. I expect
standard Linux behavior and structure, that's why I like TW. Others do
not follow this precept and are simply messed with or dictate too much
about what I can use. As to any platform, you can do some
cross-compiling but a run anywhere app is difficult to do, especially if
it is a real-time app.You want to leverage the full capabilities of the
OS, so generalizing it is not always a good idea.

I have always used KDE starting with REDHAT 7.0 (and whatever KDE version they were using )  .....  I like NEON because similar to TW,  it's running the latest Plasma (and I liked TW too!)

It may be that some of the issues folks are having are with the Python
venv and either getting that going or having it working and then
inadvertently running another Python app that changes the venv to
something else.

Rick Kunath, K9AO

I am not familiar with Python at all, nor am I familiar with virtual environments.

I have really been pretty much only on the 'user" side of Linux since the late 90's and have not been "under the hood" much other than "checking the oil".  That still makes me pretty much a novice!

[Rick Kunath]

Rick,

I'd suggest a bug report to the Tumbleweed Bugzilla if you ever get one
of these bugs again. It does not need to be in software-developer-ese,
so just put in the report what you see, or anything a terminal spits out
when you run the app from a command line. Usually it gets fixed in a day
or two and the developers of the offending package then knows what not
to do again. I have seen a fix come in hours.

Snapshots are one of the best things about TW. Because of the BTRFS file
system you can roll back to however many snapshots you told TW you want
to keep. How many depends on disk space. If something breaks, it is a
simple thing to tell TW to roll back. You can then roll forward after
you see a bugfix for the issue. You can look at the Bugzilla to see if
someone has already reported the issue. Then when the fix is in do a
zypper dup again. I keep my /home directories on a separate XFS
partition and because of that no personal info, emails, messages, or any
of that ever rolls back.

No, generally thee source built app won't break on a distro update
(that's update not upgrade since we are talking here about TW that is a
rolling release), so there is no such thing as a yearly complete update.
These rolling releases come incrementally, sometimes several per day,
but you can update to whatever frequency you want to. I never have to
wait for new features and generally if possible lib developers do not
try to break backwards compatibility. Out of a hundred or so updates in
a year I may have to rebuild one or two apps. But it is a simple thing
to do, you just rebuild it again and you're set. Linux is very good
about keeping distro stuff (/usr tree) separated from source built stuff
(/usr/local tree). Of course there may and usually are distro libs in
use. So no worries about breakage, and it would not break the distro in
any case. An app just would error out, and you'd just do a quick
rebuild. I expect when the RADE release gets ported to  instead C++ of
using the Python virtual environment it'll get a distro provided package.

TW is at the latest KDE Plasma 6 and runs on the Wayland compositor very
nicely (It'll run the old X11 also).

A Python virtual environment is a sort of virtual machine. You load
Python applications etc. into it and then these and your virtual Python
application run inside of it. It is handy but not CPU efficient, though
it is actually pretty good in that regard. But it is more distro
agnostic. Some other application using a virtual environment might stop
the FreeDV environment. But a simple restarting it if RADE won't run is
all that's needed. That won't happen once RADE is ported to C++.

Rick Kunath, K9AO