pkg 1.10.99.10 now totally dead on Linux

[Dan Partelly]

Well, pkg was now updated to pkg 1.10.99.10, and the result is very bad. Until now, pkg used to work once in 4-5 tries, now it segfaults regularly at any attempt to install anything. Of course, it did let me uninstall ravenadm, ironically. Which leaves we with no option but to try to reinstall manually the content of ravenadm package.

I tell you John, this package manager needs work for Linux. It's far from being usable. Every time I want to use ravenports on Linux I end up wasting time fighting pkg instead of enjoying the system you built.

How does pkg work on Solaris and MacOSx ?

And also, if you already forked pkg to add zstd support, why did you not removed all legacy compression formats to cut dependencies down ? In all fairness I dont think FreeBSD will be very interested in the work you do and I don't think they will adopt too fast (if anytime) new formats. So why not let it diverge ?

thanks

[John Marino]

I'm not seeing segfaults.  I am seeing "Unrecognized archive format" related to zstd packages which is new (probably with new libarchive dependency)

Are you sure all your errors are segfaults?

[Dan Partelly]

Yes, they are segfaults. Most errors are Ive seen with pkg on Arch Linux  (all if I don't count the sqlite issue) where segfaults, and all I guess they are related to memory management. My home system is otherwise remarkably stable even if it runs latest glibc and latest kernel. Can runs hours of compiling complex C++ projects without any issues.

This is why I want to get ASAN instrumentation in pkg and track it down , because it is really unusable in my setup. I like your project enormously but pkg is kust a pain in the ass.  May work better on old stable kernel and libc, I didnt tried on a Centos or Red Hat.

One way or another , this needs to be fixed. 

On Sep 24, 2018, at 20:23, John Marino <synsport....@gmail.com> wrote:

I'm not seeing segfaults.  I am seeing "Unrecognized archive format" related to zstd packages which is new (probably with new libarchive dependency)

Are you sure all your errors are segfaults?

--
You received this message because you are subscribed to the Google Groups "Ravenports" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ravenports+...@googlegroups.com.
To post to this group, send email to raven...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/ravenports/7e27e552-c21b-45c9-b05e-cfa41d04f2e9%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[John Marino]

Okay, the issue *I* was seeing was a result of libarchive being misbuilt after I split Zstandard into shared and static packages.  After rebuilding and bumping libarchive, rebuilding the downstream and reinstalling pkg, it works as before.

Yes, I get the occasional segfault but retrying the command works (as before).  I know this sucks and is unacceptable and needs a debugger to figure out where the pkg(8) bug is.

I'm definitely not seeing segfaults on every command.

I'd recommend installing the latest pkg I just uploaded and see if the segfaults were caused by the zstd problem.

[dan_pa...@rdsor.ro]

I re-fetched pkg bootstrap, it worked first time trying to upgrade
itself to 1.10.99.10_2, the upgrade/install:
New packages to be INSTALLED:
libarchive-single-standard: 3.3.3_1
Zstandard-shared-standard: 1.3.5

Installed packages to be UPGRADED:
ravenadm-single-standard: 1.10 -> 1.11
pkg-bsd-shared-standard: 1.10.99.7_3 -> 1.10.99.10_2
nss-caroot-standard: 3.38 -> 3.39


it crashed, restarted it, but after fetching Zstandard-shared-standard
it crashed again and since that moment it just segfaults regularly,
cannot do any install work with it.

so, no joy

[John Marino]

It sounds like it's pretty clearly having an issue on the platform you're using, so it would be helpful to have a thorough description of which system that is.  distro, kernel, glibc version, etc.

[Dan Partelly]

It's Archlinux :

 4.18.9-arch1-1-ARCH #1 SMP PREEMPT Wed Sep 19 21:19:17 UTC 2018 x86_64 GNU/Linux

$ ldd --version
ldd (GNU libc) 2.28

Note ABI, 3.2.0  , which was changed by glibc several versions ago, in 2.26, and became mandatory for all architectures supported by kernel 3.2.0

$readelf -n /bin/sh

Displaying notes found in: .note.ABI-tag
  Owner                 Data size       Description
  GNU                  0x00000010       NT_GNU_ABI_TAG (ABI version tag)
    OS: Linux, ABI: 3.2.0

Displaying notes found in: .note.gnu.build-id
  Owner                 Data size       Description
  GNU                  0x00000014       NT_GNU_BUILD_ID (unique build ID bitstring)
    Build ID: 42602c973215ba5b8ab5159c527e72f38e83ee52