Consolidations still fail on volume that doesn't change ERR=cats/sql_get.cc:267 No Job found for JobName ''

[Brock Palen]

I had posted this before but is still heppening where there appears to be consolidation issues with volumes that don’t have anything change or that’s my assumption at least.
https://www.mail-archive.com/bareos...@googlegroups.com/msg06715.html

Behavior is there is a time to consolidate but the consolidation will fail with:

16-Apr 08:52 myth-dir JobId 103069: Version: 24.0.3~pre0.54685a85d (27 March 2025) Ubuntu 22.04.5 LTS
16-Apr 08:52 myth-dir JobId 103069: Start Virtual Backup JobId 103069, Job=sch-hp-desktop-Users-Pictures.2025-04-16_08.52.03_37
16-Apr 08:52 myth-dir JobId 103069: Unable to get Job record. ERR=cats/sql_get.cc:267 No Job found for JobName ''

16-Apr 08:52 myth-dir JobId 103069: No files found to read. No bootstrap file written.
16-Apr 08:52 myth-dir JobId 103069: Fatal error: Could not create bootstrap file
16-Apr 08:52 myth-dir JobId 103069: Replicating deleted files from jobids 101984,102016,102055,102099 to jobid 103069
16-Apr 08:52 myth-dir JobId 103069: Error: Bareos myth-dir 24.0.3~pre0.54685a85d (27Mar25):
Build OS: Ubuntu 22.04.5 LTS
JobId: 103069
Job: sch-hp-desktop-Users-Pictures.2025-04-16_08.52.03_37
Backup Level: Virtual Full
Client: "sch-hp-desktop-fd" 24.0.1~pre27.250812184 (24Jan25) Microsoft Windows 8 (build 9200), 64-bit,Windows-native
FileSet: "Windows All Users Pictures" 2019-03-24 21:28:55
Pool: "AI-Consolidated" (From Job Pool's NextPool resource)
Catalog: "myth_catalog" (From Client resource)
Storage: "File" (From Storage from Pool's NextPool resource)
Scheduled time: 16-Apr-2025 08:52:03
Start time: 26-Mar-2025 01:17:20
End time: 26-Mar-2025 01:18:28
Elapsed time: 1 min 8 secs
Priority: 8
Allow Mixed Priority: no
SD Files Written: 0
SD Bytes Written: 0 (0 B)
Rate: 0.0 KB/s
Volume name(s):
Volume Session Id: 0
Volume Session Time: 0
Last Volume Bytes: 0 (0 B)
SD Errors: 0
SD termination status:
Accurate: yes
Bareos binary info: Bareos community build (UNSUPPORTED): Get professional support from https://www.bareos.com
Job triggered by: User
Termination: *** Backup Error ***



| 102908 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-03-22 01:51:07 | 00:01:10 | B | F | 42,740 | 384,907,132,555 | T |
| 101984 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-03-23 02:41:40 | 00:01:07 | B | I | 1 | 0 | T |
| 102016 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-03-24 02:52:38 | 00:01:10 | B | I | 1 | 0 | T |
| 102055 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-03-25 01:13:22 | 00:01:12 | B | I | 1 | 0 | T |
| 102099 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-03-26 01:17:20 | 00:01:08 | B | I | 1 | 0 | T |
| 102144 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-03-27 01:17:23 | 00:01:15 | B | I | 1 | 0 | T |
| 102185 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-03-28 01:50:46 | 00:01:12 | B | I | 1 | 0 | T |
| 102222 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-03-29 02:40:21 | 00:01:13 | B | I | 2 | 0 | T |
| 102355 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-03-30 11:34:40 | 00:01:12 | B | I | 2 | 0 | T |
| 102428 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-04-01 02:41:19 | 00:01:07 | B | I | 3 | 150 | T |
| 102474 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-04-02 01:13:24 | 00:01:08 | B | I | 2 | 0 | T |
| 102517 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-04-03 01:17:33 | 00:01:08 | B | I | 2 | 0 | T |
| 102559 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-04-04 01:17:36 | 00:01:09 | B | I | 2 | 0 | T |
| 102603 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-04-05 01:50:46 | 00:01:07 | B | I | 2 | 0 | T |
| 102645 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-04-06 01:50:49 | 00:01:31 | B | I | 2 | 0 | T |
| 102682 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-04-07 02:41:22 | 00:01:09 | B | I | 2 | 0 | T |
| 102723 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-04-08 02:39:28 | 00:01:03 | B | I | 3 | 150 | T |
| 102766 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-04-09 02:39:37 | 00:01:10 | B | I | 12 | 2,271,549 | T |
| 102807 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-04-10 01:13:21 | 00:01:09 | B | I | 2 | 0 | T |
| 102852 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-04-11 01:17:31 | 00:01:14 | B | I | 2 | 0 | T |
| 102888 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-04-12 01:17:35 | 00:01:25 | B | I | 2 | 0 | T |
| 102928 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-04-13 01:50:45 | 00:01:22 | B | I | 1 | 0 | T |
| 102963 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-04-14 01:50:48 | 00:01:11 | B | I | 2 | 0 | T |
| 103002 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-04-15 02:40:14 | 00:01:18 | B | I | 2 | 0 | T |
| 103043 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-04-16 02:40:17 | 00:01:26 | B | I | 2 | 0 | T |


Brock Palen
bro...@mlds-networks.com
www.mlds-networks.com
Websites, Linux, Hosting, Joomla, Consulting

[Bruno Friedmann (bruno-at-bareos)]

Can you publish the consolidation job log (the one creating that consolidation) at least the part concerning this one...

[Brock Palen]

Sure:

16-Apr 09:49 myth-dir JobId 103070: Looking at always incremental job sch-hp-desktop-Users-Pictures
16-Apr 09:49 myth-dir JobId 103070: sch-hp-desktop-Users-Pictures: considering jobs older than 26-Mar-2025 09:49:11 for consolidation.
16-Apr 09:49 myth-dir JobId 103070: before ConsolidateFull: jobids: 102908,101984,102016,102055,102099
16-Apr 09:49 myth-dir JobId 103070: check full age: full is 22-Mar-2025 01:52:17, allowed is 19-Mar-2025 09:49:11
16-Apr 09:49 myth-dir JobId 103070: Full is newer than AlwaysIncrementalMaxFullAge -> skipping first jobid 102908 because of age
16-Apr 09:49 myth-dir JobId 103070: after ConsolidateFull: jobids: 101984,102016,102055,102099
16-Apr 09:49 myth-dir JobId 103070: sch-hp-desktop-Users-Pictures: Start new consolidation
16-Apr 09:49 myth-dir JobId 103070: Using Catalog "myth_catalog"
16-Apr 09:49 myth-dir JobId 103070: Job queued. JobId=103071
16-Apr 09:49 myth-dir JobId 103070: Consolidating JobId 103071 started.

Brock Palen
bro...@mlds-networks.com
www.mlds-networks.com
Websites, Linux, Hosting, Joomla, Consulting

> --
> You received this message because you are subscribed to the Google Groups "bareos-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to bareos-users...@googlegroups.com.
> To view this discussion visit https://groups.google.com/d/msgid/bareos-users/36f56c75-6dd7-4e67-b193-04d1a580eee4n%40googlegroups.com.

[Bruno Friedmann (bruno-at-bareos)]

Hi Brock, 

Thanks for the report. As before trying to fix anything we have to reproduce the case could you confirm the following.

This happen only when the whole set of jobid considered for consolidation has 0 files in?

When this condition is matched the error is always triggered?

[Bruno Friedmann (bruno-at-bareos)]

Looking at your report it seems there's at least one file but 0 bytes ?

| 103002 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-04-15 02:40:14 | 00:01:18 | B | I | 2 | 0 | T |

| 103043 | sch-hp-desktop-Users-Pictures | sch-hp-desktop-fd | 2025-04-16 02:40:17 | 00:01:26 | B | I | 2 | 0 | T |

Could you share (or privately) the `list joblog jobid=103043` and the `list files jobid=103043`

It look like you are in a corner case, that need to be reproduced and added to the CI test.

In 24 and 25 we have mechanism that filters empty jobid (but that mean no file, no data)

In consolidation you might find something similar to this

```

17-Apr 09:47 bareos-dir JobId 15: Start Consolidate JobId 15, Job=Consolidate.2025-04-17_09.47.52_24
17-Apr 09:47 bareos-dir JobId 15: Looking at always incremental job ai-backup-bareos-fd
17-Apr 09:47 bareos-dir JobId 15: ai-backup-bareos-fd: considering jobs older than 17-Apr-2025 09:47:53 for consolidation.
17-Apr 09:47 bareos-dir JobId 15: ai-backup-bareos-fd: purging empty jobids 12,13,14
17-Apr 09:47 bareos-dir JobId 15: ai-backup-bareos-fd: less incrementals than required, not consolidating

```

[Bruno Friedmann (bruno-at-bareos)]

Get time to test that so file counted with 0 bytes are often deleted file/dir but those get written on volumes too, so bscan can restore the fact they got deleted.

So far, the test doesn't reveal any kind of trouble.

Your error looks more like a missing job (maybe one of your volume get prune/purged either by hand or by mis-configuration, AI being nit picky on volume conservation).