Upgrade 18.2.5-144.1 -> 19.2.5-1 : bareos-dir dumps core

[Peter Van Biesen]

Hi,

OS: Debian buster 10.2

uname: Linux vbxl398 4.19.0-6-amd64 #1 SMP Debian 4.19.67-2+deb10u2 (2019-11-11) x86_64 GNU/Linux

Database: Postgresql 12.1-1.pgdg100+1

I upgraded bareos with 'apt full-upgrade' from 18.2.5-144.1 to 19.2.5-1 after which bareos-dir no longer starts. I assumed something was amiss in the configuration ( which was running find on 18.2 ), but even a -t gives a dump :

#/usr/sbin/bareos-dir -t
terminate called after throwing an instance of 'std::logic_error'
  what():  basic_string::_M_construct null not valid
BAREOS interrupted by signal 6: IOT trap
bareos-dir, bareos-dir got signal 6 - IOT trap. Attempting traceback.
exepath=/usr/sbin/
Calling: /usr/sbin/btraceback /usr/sbin/bareos-dir 21882 /tmp/
bsmtp: tools/bsmtp.cc:129-0 Fatal malformed reply from localhost: 501 <root>: sender address must contain a domain                                                                                                
The btraceback call returned 1
Dumping: /tmp//bareos-dir.21882.bactrace

This is the output from gdb :

/tmp#gdb /usr/sbin/bareos-dir bareos-dir.core.21882
GNU gdb (Debian 8.2.1-2+b3) 8.2.1
Copyright (C) 2018 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
    <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/sbin/bareos-dir...(no debugging symbols found)...done.
[New LWP 21882]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/sbin/bareos-dir'.
#0  0x00007fa1dc03b094 in __waitpid (pid=21883, stat_loc=0x7ffd42aef4ec, options=0) at ../sysdeps/unix/sysv/linux/waitpid.c:30
30      ../sysdeps/unix/sysv/linux/waitpid.c: No such file or directory.
(gdb) where
#0  0x00007fa1dc03b094 in __waitpid (pid=21883, stat_loc=0x7ffd42aef4ec, options=0) at ../sysdeps/unix/sysv/linux/waitpid.c:30
#1  0x00007fa1dc43fd15 in SignalHandler () from /usr/lib/bareos/libbareos.so.19
#2  <signal handler called>
#3  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
#4  0x00007fa1db703535 in __GI_abort () at abort.c:79
#5  0x00007fa1dbacd983 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#6  0x00007fa1dbad38c6 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#7  0x00007fa1dbad3901 in std::terminate() () from /lib/x86_64-linux-gnu/libstdc++.so.6
#8  0x00007fa1dbad3b34 in __cxa_throw () from /lib/x86_64-linux-gnu/libstdc++.so.6
#9  0x00007fa1dbacf7d3 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#10 0x00007fa1dc4593ac in ConfigurationParser::StoreMsgs(s_lex_context*, ResourceItem*, int, int) () from /usr/lib/bareos/libbareos.so.19
#11 0x00007fa1dc45d865 in ConfigurationParser::StoreResource(int, s_lex_context*, ResourceItem*, int, int) () from /usr/lib/bareos/libbareos.so.19
#12 0x00007fa1dc4607aa in ConfigParserStateMachine::ScanResource(int) () from /usr/lib/bareos/libbareos.so.19
#13 0x00007fa1dc460fdb in ConfigParserStateMachine::ParseAllTokens() () from /usr/lib/bareos/libbareos.so.19
#14 0x00007fa1dc45df96 in ConfigurationParser::ParseConfigFile(char const*, void*, void (*)(char const*, int, s_lex_context*, char const*, ...), void (*)(char const*, int, s_lex_context*, char const*, ...)) ()
   from /usr/lib/bareos/libbareos.so.19
#15 0x00007fa1dc45ed35 in ConfigurationParser::ParseConfig() () from /usr/lib/bareos/libbareos.so.19
#16 0x00005566f7c3cdc6 in main ()
(gdb)

For what I can see, the problem is in ConfigurationParser::StoreMsgs .

Can someone shed some light on this ?

Thanks !

Peter.

[Andreas Rogge]

Hi,

as you might have already suspected, this is probably a bug. AFAICT
you're the second person to report this. Right now we couldn't reproduce
the problem yet. I would be glad if you could help us with this.

Would you mind sharing the configuration of your messages resources?
(i.e. the files in /etc/bareos/bareos-dir.d/messages/*.conf)

Having said that, there will probably be a simple way to work around
that problem.

Thank you very much!

Best Regards,
Andreas

Am 05.02.20 um 10:38 schrieb Peter Van Biesen:

> Hi,
>
> OS: Debian buster 10.2
> uname: Linux vbxl398 4.19.0-6-amd64 #1 SMP Debian 4.19.67-2+deb10u2
> (2019-11-11) x86_64 GNU/Linux
> Database: Postgresql 12.1-1.pgdg100+1
>
> I upgraded bareos with 'apt full-upgrade' from 18.2.5-144.1 to 19.2.5-1
> after which bareos-dir no longer starts. I assumed something was amiss
> in the configuration ( which was running find on 18.2 ), but even a -t
> gives a dump :
> |
> #/usr/sbin/bareos-dir -t
> terminate called after throwing an instance of 'std::logic_error'
>   what(): basic_string::_M_construct nullnotvalid
> BAREOS interrupted bysignal 6:IOT trap
> bareos-dir,bareos-dir got signal 6-IOT trap.Attemptingtraceback.
> exepath=/usr/sbin/
> Calling:/usr/sbin/btraceback /usr/sbin/bareos-dir 21882/tmp/
> bsmtp:tools/bsmtp.cc:129-0Fatalmalformed reply

> fromlocalhost:501<root>:sender address must contain a domain            
>                                                                        
>            
> Thebtraceback call returned 1

> Dumping:/tmp//bareos-dir.21882.bactrace
> |
>
> This is the output from gdb :
> |
> /tmp#gdb /usr/sbin/bareos-dir bareos-dir.core.21882
> GNU gdb (Debian8.2.1-2+b3)8.2.1
> Copyright(C)2018FreeSoftwareFoundation,Inc.
> LicenseGPLv3+:GNU GPL version 3orlater <http://gnu.org/licenses/gpl.html>

> Thisisfree software:you are free to change andredistribute it.

> ThereisNO WARRANTY,to the extent permitted bylaw.
> Type"show copying"and"show warranty"fordetails.

> ThisGDB was configured as"x86_64-linux-gnu".

> Type"show configuration"forconfiguration details.
> Forbug reporting instructions,please see:
> <http://www.gnu.org/software/gdb/bugs/>.

> Findthe GDB manual andother documentation resources online at:
>     <http://www.gnu.org/software/gdb/documentation/>.
>
> Forhelp,type "help".

> Type"apropos word"to search forcommands related to "word"...
> Readingsymbols from/usr/sbin/bareos-dir...(nodebugging symbols
> found)...done.
> [NewLWP 21882]
> [Threaddebugging usinglibthread_db enabled]
> Usinghost libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".

> Corewas generated by`/usr/sbin/bareos-dir'.

> Raadpleeg uw dossier online via het e-loket mijnvaph.be
> <https://mijn.vaph.be>
>
> --
> You received this message because you are subscribed to the Google
> Groups "bareos-users" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to bareos-users...@googlegroups.com
> <mailto:bareos-users...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/bareos-users/3b999bc6-baa0-423d-ab4e-2158aa44fef9%40googlegroups.com
> <https://groups.google.com/d/msgid/bareos-users/3b999bc6-baa0-423d-ab4e-2158aa44fef9%40googlegroups.com?utm_medium=email&utm_source=footer>.

--
Andreas Rogge andrea...@bareos.com
Bareos GmbH & Co. KG Phone: +49 221-630693-86
http://www.bareos.com

Sitz der Gesellschaft: Köln | Amtsgericht Köln: HRA 29646
Komplementär: Bareos Verwaltungs-GmbH
Geschäftsführer: S. Dühr, M. Außendorf, J. Steffens, Philipp Storz

[Peter Van Biesen]

I will send you the configs privately.

Kindest regards,

Peter.

To unsubscribe from this group and stop receiving emails from it, send an email to bareos-users...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bareos-users/bbc5e9ca-c5a5-0ced-08cb-9457f2284a73%40bareos.com.

--

Peter Van Biesen
Systems Administrator
IT-Team/exploitatie&beheer

VLAAMS AGENTSCHAP VOOR PERSONEN MET EEN HANDICAP
T +32 2 249 33 47
peter.v...@vaph.be
Zenithgebouw, Koning Albert II-laan 37, 1030 Brussel
www.vaph.be

////////////////////////////////////////////////////////////////////////////////////////////////////

[Andreas Rogge]

Hi Peter,

thank you very much for that.
I have identified what causes the crash. You configured logging to
syslog - the 19.2 config-parser doesn't seem to like this anymore. Sorry
for that :(

As a quick workaround, comment out all "syslog"-settings from your
messages resources and Bareos should work again.
In the meantime, we'll be working on a fix.

Best Regards,
Andreas

Am 06.02.20 um 09:19 schrieb Peter Van Biesen:

> <http://mijnvaph.be>

> > <https://mijn.vaph.be>
> >
> > --
> > You received this message because you are subscribed to the Google
> > Groups "bareos-users" group.
> > To unsubscribe from this group and stop receiving emails from it, send
> > an email to bareos-users...@googlegroups.com

> <mailto:bareos-users%2Bunsu...@googlegroups.com>
> > <mailto:bareos-users...@googlegroups.com
> <mailto:bareos-users%2Bunsu...@googlegroups.com>>.

> > To view this discussion on the web visit
> >
> https://groups.google.com/d/msgid/bareos-users/3b999bc6-baa0-423d-ab4e-2158aa44fef9%40googlegroups.com
> >
> <https://groups.google.com/d/msgid/bareos-users/3b999bc6-baa0-423d-ab4e-2158aa44fef9%40googlegroups.com?utm_medium=email&utm_source=footer>.
>
> --
>   Andreas Rogge                             andrea...@bareos.com

> <mailto:andrea...@bareos.com>

>   Bareos GmbH & Co. KG                      Phone: +49 221-630693-86
>   http://www.bareos.com
>
>   Sitz der Gesellschaft: Köln | Amtsgericht Köln: HRA 29646
>   Komplementär: Bareos Verwaltungs-GmbH
>   Geschäftsführer: S. Dühr, M. Außendorf, J. Steffens, Philipp Storz
>
> --
> You received this message because you are subscribed to the Google
> Groups "bareos-users" group.
> To unsubscribe from this group and stop receiving emails from it,
> send an email to bareos-users...@googlegroups.com

> <mailto:bareos-users%2Bunsu...@googlegroups.com>.

> To view this discussion on the web visit

> https://groups.google.com/d/msgid/bareos-users/bbc5e9ca-c5a5-0ced-08cb-9457f2284a73%40bareos.com.
>
>
>
> --
>
> Peter Van Biesen
> Systems Administrator
> IT-Team/exploitatie&beheer
>
> VLAAMS AGENTSCHAP VOOR PERSONEN MET EEN HANDICAP

> *T* +32 2 249 33 47 <tel:+32+2+249+33+47>
> peter.v...@vaph.be <mailto:peter.v...@vaph.be>

> Zenithgebouw, Koning Albert II-laan 37, 1030 Brussel

> www.vaph.be <http://www.vaph.be>
>
> ////////////////////////////////////////////////////////////////////////////////////////////////////

>
>
> Raadpleeg uw dossier online via het e-loket mijnvaph.be
> <https://mijn.vaph.be>
>
> --
> You received this message because you are subscribed to the Google
> Groups "bareos-users" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to bareos-users...@googlegroups.com
> <mailto:bareos-users...@googlegroups.com>.
> To view this discussion on the web visit

> https://groups.google.com/d/msgid/bareos-users/CAHGw5uVrwTTUhK%2B%3D8OWT7d4hKxV8UJheoOCa-nFj5KnRjONzEQ%40mail.gmail.com
> <https://groups.google.com/d/msgid/bareos-users/CAHGw5uVrwTTUhK%2B%3D8OWT7d4hKxV8UJheoOCa-nFj5KnRjONzEQ%40mail.gmail.com?utm_medium=email&utm_source=footer>.

[Peter Van Biesen]

Hi Andreas,

after disabling syslog, bareos-dir no longer coredumps. I do get an error :

bareos-dir: dird/check_catalog.cc:65-0 Could not open Catalog "MyCatalog", database "bareos".
bareos-dir: dird/check_catalog.cc:71-0 Version error for database "bareos". Wanted 2192, got 2171
bareos-dir ERROR TERMINATION
Please correct the configuration in /etc/bareos/bareos-dir.conf

But after running /usr/lib/bareos/scripts/update_bareos_tables as user postgres, all is well.

Thanks so much for your help !

Peter.

To unsubscribe from this group and stop receiving emails from it, send an email to bareos-users...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bareos-users/16db7ecf-b228-7d1a-46e7-da76a2ea3860%40bareos.com.

--

Peter Van Biesen
Systems Administrator
IT-Team/exploitatie&beheer

VLAAMS AGENTSCHAP VOOR PERSONEN MET EEN HANDICAP

T +32 2 249 33 47

peter.v...@vaph.be
Zenithgebouw, Koning Albert II-laan 37, 1030 Brussel
www.vaph.be

////////////////////////////////////////////////////////////////////////////////////////////////////

[Andreas Rogge]

Hi Peter,

> Thanks so much for your help!

I'm always happy to help. And thank you very much for *your* help! We
probably wouldn't have figured it out so quickly without you.

Best Regards,
Andreas