Bug#1001935: calamaris: Calamaris stopped to recognise squid logs

Kamil Jonca

unread,

Dec 19, 2021, 4:30:03 AM12/19/21

to

Package: calamaris
Version: 2.99.4.5-3
Severity: normal
Tags: upstream
X-Debbugs-Cc: kjo...@poczta.onet.pl

Recently I started to get strange messages from calamaris:
============================
/usr/bin/calamaris: I don't know this input format. Please check the
input. If you're sure that the following line is NOT corrupt and the error
also occurs with the recent version of Calamaris (see the README for pointers
and known bugs) then report it with the following line to
<Calama...@Cord.de>. Thank You.

1639177208.747 0 192.168.200.244 NONE_NONE/000 0 - error:transaction-end-before-headers - HIER_NONE/- -
============================

Squid logs seem not to be corrupted.
TBH I am not sure if it bug in calamaris or change in squid.

-- System Information:
Debian Release: bookworm/sid
APT prefers unstable
APT policy: (500, 'unstable'), (500, 'oldstable')
Architecture: amd64 (x86_64)
Foreign Architectures: i386

Kernel: Linux 5.15.0-2-amd64 (SMP w/12 CPU threads)
Locale: LANG=pl_PL.UTF-8, LC_CTYPE=pl_PL.UTF-8 (charmap=UTF-8), LANGUAGE not set
Shell: /bin/sh linked to /usr/bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled

Versions of packages calamaris depends on:
ii bc 1.07.1-3+b1
ii debconf [debconf-2.0] 1.5.79
ii perl 5.32.1-6

calamaris recommends no packages.

Versions of packages calamaris suggests:
pn libgd-graph-perl <none>
ii libnetaddr-ip-perl 4.079+dfsg-1+b5
ii squid 5.2-1

-- debconf information excluded

Cord Beermann

unread,

Dec 19, 2021, 5:30:04 AM12/19/21

to

Hallo! Du (Kamil Jonca) hast geschrieben:

>Recently I started to get strange messages from calamaris:
>============================
>/usr/bin/calamaris: I don't know this input format. Please check the
>input. If you're sure that the following line is NOT corrupt and the error
>also occurs with the recent version of Calamaris (see the README for pointers
>and known bugs) then report it with the following line to
><Calama...@Cord.de>. Thank You.
>
>1639177208.747 0 192.168.200.244 NONE_NONE/000 0 - error:transaction-end-before-headers - HIER_NONE/- -
>============================
>
>Squid logs seem not to be corrupted.
>TBH I am not sure if it bug in calamaris or change in squid.

Calamaris uses the first line of a logfile to determine the format of the
input as default.

The line that has been provided looks unusual, so most likely the Regexp that
tries to guess the format does not match and it bails out. You can workaround
by running calamaris with the switch

--input-format squid

Cord

Cord Beermann

unread,

Dec 19, 2021, 7:40:03 AM12/19/21

to

Hallo! Du (Cord Beermann) hast geschrieben:

I uploaded an update to Github https://github.com/C0RD/calamaris

the fix that make it work is here in calamaris:

old: m#^\s*\d+\.\d+\s+\d+\s+[\w\-\.:]+\s+\w+/\d+\s+\d+\s+\w+\s+\S+\s+\S+\s+\w+/\S+\s+\S+$#
new: m#^\s*\d+\.\d+\s+\d+\s+[\w\-\.:]+\s+\w+/\d+\s+\d+\s+[\w-]+\s+\S+\s+\S+\s+\w+/\S+\s+\S+$#

Cord

Daniel Echeverri

unread,

Dec 19, 2021, 11:00:03 AM12/19/21

to

Hello!

Could you make a release or create a tag in Github repo with this new version to package it?

Thanks!

--

Daniel Echeverri
Debian Developer
Linux user: #477840
GPG Fingerprint:
D0D0 85B1 69C3 BFD9 4048 58FA 21FC 2950 4B52 30DB

Cord Beermann

unread,

Dec 19, 2021, 12:10:03 PM12/19/21

to

Hallo! Du (Daniel Echeverri) hast geschrieben:

>Could you make a release or create a tag in Github repo with this new
>version to package it?

will do. Currently Regressiontests are in progress.

Cord

Cord Beermann

unread,

Dec 25, 2021, 9:20:03 AM12/25/21

to

Hallo! Du (Cord Beermann) hast geschrieben:

>will do. Currently Regressiontests are in progress.

you can get it here: https://cord.de/files/calamaris/calamaris-2.99.4.7.tar.gz

Cord