Got a problem, message: Can't list directory

[Gregory S]

Hi guys,

after a few times of successful backups my cron job has stopped to work properly.

First of all I tried to execute backup command manually and here it is:

root@backup:~# cat /mnt/windows/fullap.dmp | zbackup backup --non-encrypted /backup/assistent/backups/fullap-`stat --printf %y /mnt/windows/fullap.dmp | /usr/bin/cut -f 1 -d ' '`.dmp

Loading index...

Loading index file 71357a6c3bcd96c1b9e218167b3bd5a89d13241739764238...

Loading index file 7d33da3037b7f30ea531402f441086948d37ff654d7c88eb...

Loading index file b5aadbe3c64769edd9ecadf79e93827a53f127f14b9f5fe1...

Loading index file f9a19c71e6ea7ed9227037492fd8862d291dc1dd60dd9565...

Loading index file 0f937681c75a71c7739d51d8e70ebe262bcbb70390f8e21d...

Loading index file ce47d4003ba4c98a4197bced9684f3e28c639a68dc544ce4...

Loading index file 7b6ba436fa2ea3c1f0994aa35a2ac61be452b1539ab31dd6...

Loading index file b4fc2be7a4324bc8db2198d39ec9aab1aa6817e47c0c9ec8...

Loading index file 36b6961f89f29d239f42de06aeed448e9a99416ce932b969...

Loading index file 94243d13df3dc522ce70e69f06aefec619c6c3cb1ef46d42...

Loading index file 25fbb6e84be2d515eddb19028fd2d9dfb90e4252bd0441d4...

Loading index file 6520e784c7fe6ef63b0e8cfbe6d743d8c0105e04f6201014...

Loading index file cc4a21b19416bfd21d6aff40baa55632bdb6def380024eb0...

Loading index file 843fd7d97194370127a3b6e9d39c58026859c19a219accce...

Loading index file 3a3e1b09a40427978158b32e61b1c205da72b8e94d3ad492...

Loading index file b7999091cf61bc5ae15940228f9155ac16b26a0e2d61543f...

Loading index file 2c4acdf918c38ff5338e36d5f2bd81db85f061688285e2e3...

Loading index file 428e744c37aea39989c7d9836978e5012a53387b3355a71c...

Loading index file 482164c0ac0c934a9d34d0f598772914b1eb34ec4370944f...

Loading index file 31fe8a288a0dd1ceca77749ad48b6fe72a48e8bedfa1ae02...

Loading index file f0cb6e9ffbf9044b77be9b7f0de7c0eea1060cef96554543...

Loading index file de033e844fa48ea92dd855f8e50bf16b4d67800f2d0be629...

Loading index file cef1a706c49917d154e752375e97a3cd9aa8a8fc768875d2...

Can't list directory /backup/assistent/index

So guys, please help to investigate this issue. Filesystem is ok as well as hdd.

ls "/backup/assistent/index" gives normal output of 28 files.

I use zbackup version 1.4 compiled from sources.

Regards!

[Vladimir Stackov]

Greetings,

please show output of following commands:

1. ls -liahsR /backup/assistent/backups/
2. ls -liahsR /backup/assistent/index/

> --
> You received this message because you are subscribed to the Google Groups
> "ZBackup general discussion" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to zbackup+u...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.



--
Kind regards,
Vladimir.

[Gregory S]

root@backup:~# ls -liahsR /backup/assistent/backups/

/backup/assistent/backups/:

total 40K

4194308 4.0K drwxr-xr-x 2 root root 4.0K Mar 17 12:00 .

4194306 4.0K drwxr-xr-x 5 root root 4.0K Mar 25 21:12 ..

4194408 4.0K -rw------- 1 root root   80 Feb 21 23:52 fullap-2015-02-21.dmp

4194428 4.0K -rw------- 1 root root   80 Feb 22 12:00 fullap-2015-02-22.dmp

4194438 4.0K -rw------- 1 root root   80 Feb 23 12:00 fullap-2015-02-23.dmp

4194449 4.0K -rw------- 1 root root   80 Feb 24 12:00 fullap-2015-02-24.dmp

4194464 4.0K -rw------- 1 root root   80 Feb 25 12:00 fullap-2015-02-25.dmp

4194477 4.0K -rw------- 1 root root   80 Feb 26 12:00 fullap-2015-02-26.dmp

4194492 4.0K -rw------- 1 root root   80 Feb 27 12:00 fullap-2015-02-27.dmp

4194503 4.0K -rw------- 1 root root   80 Feb 28 12:00 fullap-2015-02-28.dmp

 

root@backup:~# ls -liahsR  /backup/assistent/index/

/backup/assistent/index/:

total 4.4G

4194309 4.0K drwxr-xr-x 2 root root 4.0K Feb 28 12:01 .

4194306 4.0K drwxr-xr-x 5 root root 4.0K Mar 25 21:12 ..

4194409  18M -rw------- 1 root root  18M Feb 21 23:52 0f937681c75a71c7739d51d8e70ebe262bcbb70390f8e21d

4194440 8.0K -rw------- 1 root root 5.0K Feb 24 12:00 25fbb6e84be2d515eddb19028fd2d9dfb90e4252bd0441d4

4194410  12M -rw------- 1 root root  12M Feb 21 23:51 2c4acdf918c38ff5338e36d5f2bd81db85f061688285e2e3

4194465 279M -rw------- 1 root root 279M Feb 25 12:00 30c2674eaf36ea971e7b9f46506da6dcf809252cf0f77d98

4194450 140M -rw------- 1 root root 140M Feb 24 12:00 31fe8a288a0dd1ceca77749ad48b6fe72a48e8bedfa1ae02

4194367 8.0K -rw------- 1 root root 7.0K Jan 29 16:30 36b6961f89f29d239f42de06aeed448e9a99416ce932b969

4194430 8.0K -rw------- 1 root root 4.1K Feb 23 12:00 3a3e1b09a40427978158b32e61b1c205da72b8e94d3ad492

4194466 8.0K -rw------- 1 root root 5.4K Feb 26 12:00 428e744c37aea39989c7d9836978e5012a53387b3355a71c

4194366 1.5M -rw------- 1 root root 1.5M Jan 23 21:33 482164c0ac0c934a9d34d0f598772914b1eb34ec4370944f

4194312  24K -rw------- 1 root root  24K Jan 23 21:31 6520e784c7fe6ef63b0e8cfbe6d743d8c0105e04f6201014

4194429  35M -rw------- 1 root root  35M Feb 22 12:00 71357a6c3bcd96c1b9e218167b3bd5a89d13241739764238

4194479 8.0K -rw------- 1 root root 6.1K Feb 27 12:00 7b6ba436fa2ea3c1f0994aa35a2ac61be452b1539ab31dd6

4194439  70M -rw------- 1 root root  70M Feb 23 12:00 7d33da3037b7f30ea531402f441086948d37ff654d7c88eb

4194365 744K -rw------- 1 root root 741K Jan 23 21:32 843fd7d97194370127a3b6e9d39c58026859c19a219accce

4194384  16K -rw------- 1 root root  14K Feb 21 23:52 94243d13df3dc522ce70e69f06aefec619c6c3cb1ef46d42

4194416 8.0K -rw------- 1 root root 6.3K Feb 22 12:00 9d7888a6a41cfb68d6327feb48ae6f2ad6487022983720a7

4194504 2.2G -rw------- 1 root root 2.2G Feb 28 12:01 abd44b1328d6a2ec64b0871e449bae660c8cdd3ff252b5ce

4194493 1.1G -rw------- 1 root root 1.1G Feb 27 12:00 b4fc2be7a4324bc8db2198d39ec9aab1aa6817e47c0c9ec8

4194361  48K -rw------- 1 root root  47K Jan 23 21:31 b5aadbe3c64769edd9ecadf79e93827a53f127f14b9f5fe1

4194494 8.0K -rw------- 1 root root 5.5K Feb 28 12:00 b7999091cf61bc5ae15940228f9155ac16b26a0e2d61543f

4194478 558M -rw------- 1 root root 558M Feb 26 12:00 bf64d88c6e8ec60ae2006ee2f216d8dbb72bfa6b5dca57a1

4194363 188K -rw------- 1 root root 186K Jan 23 21:32 cc4a21b19416bfd21d6aff40baa55632bdb6def380024eb0

4194382 3.0M -rw------- 1 root root 3.0M Jan 29 16:30 ce47d4003ba4c98a4197bced9684f3e28c639a68dc544ce4

4194364 372K -rw------- 1 root root 371K Jan 23 21:32 cef1a706c49917d154e752375e97a3cd9aa8a8fc768875d2

4194451 8.0K -rw------- 1 root root 5.8K Feb 25 12:00 de033e844fa48ea92dd855f8e50bf16b4d67800f2d0be629

4194360  24K -rw------- 1 root root  24K Jan 23 21:31 f0cb6e9ffbf9044b77be9b7f0de7c0eea1060cef96554543

4194362  96K -rw------- 1 root root  93K Jan 23 21:31 f9a19c71e6ea7ed9227037492fd8862d291dc1dd60dd9565

 

[Vladimir Stackov]

Sorry for long delay.

This looks very strange to me.
There is only two possibilities for "Can't list directory" message and
I got no idea why readdir_r or stat call could fail.

Could you try to build latest revision from git with debug enabled and
post output again? At least I could determine if readdir_r or stat
call fails.

Thanks!

[Gregory S]

Hello,

no problem, please only help me to specify necessary options for build.

Sorry, but I was failed to get how to enable debug symbols or enable debug output.

Regards,

Greg

[Vladimir Stackov]

You should run cmake with -DCMAKE_BUILD_TYPE=Debug

[Gregory S]

Ok, I've got debug output/ Here it is

# cat /etc/group | zbackup backup --non-encrypted /backup/assistent/backups/111

[DEBUG] at main( zbackup.cc:18 ): ZBackup version 1.4

[DEBUG] at Config( config.cc:151 ): 6Config is instantiated and initialized with default values

[DEBUG] at load( storage_info_file.cc:33 ): Loading storage info...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/info, hasKey: false

[DEBUG] at load( storage_info_file.cc:75 ): Loading extended storage info, hasKey: false

Can't open extended storage info (info_extended)!

Attempting to start repo migration.

[DEBUG] at Config( config.cc:160 ): 6Config is instantiated and initialized with supplied ConfigInfo

[DEBUG] at Config( config.cc:151 ): 6Config is instantiated and initialized with default values

[DEBUG] at save( storage_info_file.cc:58 ): Saving extended storage info, hasKey: false

[DEBUG] at OutputStream( encrypted_file.cc:244 ): Saving /backup/assistent/info_extended, hasKey: false

Done.

[DEBUG] at load( storage_info_file.cc:75 ): Loading extended storage info, hasKey: false

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/info_extended, hasKey: false

Loading index...

Loading index file 71357a6c3bcd96c1b9e218167b3bd5a89d13241739764238...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/71357a6c3bcd96c1b9e218167b3bd5a89d13241739764238, hasKey: false

Loading index file 7d33da3037b7f30ea531402f441086948d37ff654d7c88eb...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/7d33da3037b7f30ea531402f441086948d37ff654d7c88eb, hasKey: false

Loading index file b5aadbe3c64769edd9ecadf79e93827a53f127f14b9f5fe1...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/b5aadbe3c64769edd9ecadf79e93827a53f127f14b9f5fe1, hasKey: false

Loading index file f9a19c71e6ea7ed9227037492fd8862d291dc1dd60dd9565...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/f9a19c71e6ea7ed9227037492fd8862d291dc1dd60dd9565, hasKey: false

Loading index file 0f937681c75a71c7739d51d8e70ebe262bcbb70390f8e21d...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/0f937681c75a71c7739d51d8e70ebe262bcbb70390f8e21d, hasKey: false

Loading index file ce47d4003ba4c98a4197bced9684f3e28c639a68dc544ce4...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/ce47d4003ba4c98a4197bced9684f3e28c639a68dc544ce4, hasKey: false

Loading index file 7b6ba436fa2ea3c1f0994aa35a2ac61be452b1539ab31dd6...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/7b6ba436fa2ea3c1f0994aa35a2ac61be452b1539ab31dd6, hasKey: false

Loading index file b4fc2be7a4324bc8db2198d39ec9aab1aa6817e47c0c9ec8...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/b4fc2be7a4324bc8db2198d39ec9aab1aa6817e47c0c9ec8, hasKey: false

Loading index file 36b6961f89f29d239f42de06aeed448e9a99416ce932b969...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/36b6961f89f29d239f42de06aeed448e9a99416ce932b969, hasKey: false

Loading index file 94243d13df3dc522ce70e69f06aefec619c6c3cb1ef46d42...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/94243d13df3dc522ce70e69f06aefec619c6c3cb1ef46d42, hasKey: false

Loading index file 25fbb6e84be2d515eddb19028fd2d9dfb90e4252bd0441d4...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/25fbb6e84be2d515eddb19028fd2d9dfb90e4252bd0441d4, hasKey: false

Loading index file 6520e784c7fe6ef63b0e8cfbe6d743d8c0105e04f6201014...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/6520e784c7fe6ef63b0e8cfbe6d743d8c0105e04f6201014, hasKey: false

Loading index file cc4a21b19416bfd21d6aff40baa55632bdb6def380024eb0...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/cc4a21b19416bfd21d6aff40baa55632bdb6def380024eb0, hasKey: false

Loading index file 843fd7d97194370127a3b6e9d39c58026859c19a219accce...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/843fd7d97194370127a3b6e9d39c58026859c19a219accce, hasKey: false

Loading index file 3a3e1b09a40427978158b32e61b1c205da72b8e94d3ad492...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/3a3e1b09a40427978158b32e61b1c205da72b8e94d3ad492, hasKey: false

Loading index file b7999091cf61bc5ae15940228f9155ac16b26a0e2d61543f...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/b7999091cf61bc5ae15940228f9155ac16b26a0e2d61543f, hasKey: false

Loading index file 2c4acdf918c38ff5338e36d5f2bd81db85f061688285e2e3...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/2c4acdf918c38ff5338e36d5f2bd81db85f061688285e2e3, hasKey: false

Loading index file 428e744c37aea39989c7d9836978e5012a53387b3355a71c...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/428e744c37aea39989c7d9836978e5012a53387b3355a71c, hasKey: false

Loading index file 482164c0ac0c934a9d34d0f598772914b1eb34ec4370944f...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/482164c0ac0c934a9d34d0f598772914b1eb34ec4370944f, hasKey: false

Loading index file 31fe8a288a0dd1ceca77749ad48b6fe72a48e8bedfa1ae02...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/31fe8a288a0dd1ceca77749ad48b6fe72a48e8bedfa1ae02, hasKey: false

Loading index file f0cb6e9ffbf9044b77be9b7f0de7c0eea1060cef96554543...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/f0cb6e9ffbf9044b77be9b7f0de7c0eea1060cef96554543, hasKey: false

Loading index file de033e844fa48ea92dd855f8e50bf16b4d67800f2d0be629...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/de033e844fa48ea92dd855f8e50bf16b4d67800f2d0be629, hasKey: false

Loading index file cef1a706c49917d154e752375e97a3cd9aa8a8fc768875d2...

[DEBUG] at InputStream( encrypted_file.cc:26 ): Loading /backup/assistent/index/cef1a706c49917d154e752375e97a3cd9aa8a8fc768875d2, hasKey: false

Can't list directory /backup/assistent/index

[Vladimir Stackov]

Very very strange. Which OS you are using?

[whites...@gmail.com]

This error may occur when the backups repository is on a SMB mount. I got the problem on a Raspberry B+. You have to compile with -D_FILE_OFFSET_BITS=64 by adding this line at the begining of CMakeLists.txt

set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -D_FILE_OFFSET_BITS=64")

It's because of fstatat() call.