question about leofs date node compaction

Martin

unread,

Mar 26, 2018, 4:54:16 AM3/26/18

to LeoProject.LeoFS

Hi friends, I have some question about leofs and data node compaction.

When I put from the command line s3cmd command like

s3cmd put ubuntu-16.04.4-server-amd64.iso s3://test/

after them checks nodes, all nodes have about 865MB data usage.

Then I try to again put command

s3cmd put ubuntu-16.04.4-server-amd64.iso s3://test/

Usage of all three nodes are about 1.7GB ( replica 3 ).

Now I sent command

s3cmd del s3://test/ubuntu-16.04.4-server-amd64.iso

After this I run command on all storages

leofs-adm compact-start stor...@172.17.3.XX all

Then I look for used space of all nodes. Used space is about 865MB.

Why each nodes remaining 865MB of used space ?

I try run

leofs-adm diagnose-start stor...@172.17.3.xx with this output example. But command output from leofs-admin is

leofs-adm whereis test/ubuntu-16.04.4-server-amd64.iso

-------+----------------------------+--------------------------------------+------------+--------------+----------------+----------------+----------------+----------------------------
del? |            node            |             ring address             |    size    |   checksum   | has children | total chunks |     clock      |             when
-------+----------------------------+--------------------------------------+------------+--------------+----------------+----------------+----------------+----------------------------
       | stor...@172.17.3.XX      |                                      |            |              |                |                |                |
       | stor...@172.17.3.XX     |                                      |            |              |                |                |                |
       | stor...@172.17.3.XX     |                                      |            |              |                |                |                |

diagnose:

194     48654293652169472977219967413208134243 test/ubuntu-16.04.4-server-amd64.iso   3       5242880 1521807289081102        2018-03-23 13:14:48 +0200       0
5243249 18630662154225910950113868836693423633 test/ubuntu-16.04.4-server-amd64.iso   14      5242880 1521807290036166        2018-03-23 13:14:49 +0200       0
10486305        1305587856473053440725201131567519039   test/ubuntu-16.04.4-server-amd64.iso   28      5242880 1521807291084707        2018-03-23 13:14:51 +0200       0
15729361        136391237899058502250970511668661014833 test/ubuntu-16.04.4-server-amd64.iso   32      5242880 1521807291420036        2018-03-23 13:14:51 +0200       0
20972417        86479128561160137101466512302604490382 test/ubuntu-16.04.4-server-amd64.iso   37      5242880 1521807291807029        2018-03-23 13:14:51 +0200       0
26215473        62735889023131669763489068514760227236 test/ubuntu-16.04.4-server-amd64.iso   73      5242880 1521807294664912        2018-03-23 13:14:54 +0200       0
31458529        137995823404141661210201733245139552832 test/ubuntu-16.04.4-server-amd64.iso   82      5242880 1521807295331245        2018-03-23 13:14:55 +0200       0
36701585        177198685779007107332347999341875637742 test/ubuntu-16.04.4-server-amd64.iso   81      5242880 1521807295260682        2018-03-23 13:14:55 +0200       0
41944641        271751427032166664349064659662183176917 test/ubuntu-16.04.4-server-amd64.iso   84      5242880 1521807295480016        2018-03-23 13:14:55 +0200       0
47187697        230684090163097641573923035431185089086 test/ubuntu-16.04.4-server-amd64.iso   93      5242880 1521807296126662        2018-03-23 13:14:56 +0200       0
52430753        91332420804438844921476576018367623451 test/ubuntu-16.04.4-server-amd64.iso   104     5242880 1521807296926762        2018-03-23 13:14:56 +0200       0
57673810        84525026973058920673781891713644762726 test/ubuntu-16.04.4-server-amd64.iso   114     5242880 1521807297683433        2018-03-23 13:14:57 +0200       0
62916867        128551868757200578465765762755348750987 test/ubuntu-16.04.4-server-amd64.iso   118     5242880 1521807298007319        2018-03-23 13:14:57 +0200       0
68159924        119126287842170527518048145358222891806 test/ubuntu-16.04.4-server-amd64.iso   119     5242880 1521807298079554        2018-03-23 13:14:57 +0200       0
73402981        106820903037813120111998310676366237888 test/ubuntu-16.04.4-server-amd64.iso   126     5242880 1521807298644084        2018-03-23 13:14:58 +0200       0
78646038        252199134750526095213746118183585323930 test/ubuntu-16.04.4-server-amd64.iso   133     5242880 1521807299098377        2018-03-23 13:14:59 +0200       0
83889095        279088278880134321869545830129770895782 test/ubuntu-16.04.4-server-amd64.iso   136     5242880 1521807299364746        2018-03-23 13:14:59 +0200       0
89132152        102157889517908859307174856038327939204 test/ubuntu-16.04.4-server-amd64.iso   141     5242880 1521807299709497        2018-03-23 13:14:59 +0200       0
94375209        79110484736612490901564643050933487127 test/ubuntu-16.04.4-server-amd64.iso   147     5242880 1521807300168658        2018-03-23 13:15:00 +0200       0
99618266        73866244164897303981551779577716780154 test/ubuntu-16.04.4-server-amd64.iso   158     5242880 1521807301065733        2018-03-23 13:15:00 +0200       0
104861323       14347049872946797675293603177765070346 test/ubuntu-16.04.4-server-amd64.iso   162     5242880 1521807301336872        2018-03-23 13:15:01 +0200       0
110104380       51541091414224355007301402500847654876 test/ubuntu-16.04.4-server-amd64.iso   168     5242880 1521807301781981        2018-03-23 13:15:01 +0200       0

Thanks.

Martin

mocchira

unread,

Mar 27, 2018, 1:53:44 AM3/27/18

to LeoProject.LeoFS

Hi Matin,

Thanks for reporting this issue.

> Why each nodes remaining 865MB of used space ?

Yes, the used data should be zero after compaction.

We tried to reproduce this issue with the latest stable 1.3.8 but couldn't.

Can you provide the information below?

- OS

- Erlang version

- LeoFS version

- Output of leofs-adm status

- error.log(s) on leo_storage(s) if those exist.

Best,

Kanno.

2018年3月26日月曜日 17時54分16秒 UTC+9 Martin:

Martin

unread,

Mar 27, 2018, 6:17:44 AM3/27/18

to LeoProject.LeoFS

Hi Kanno,

fresh install of Ubuntu 16.04.4 lts
kernel: Linux leofs-storage-02 4.4.0-116-generic #140-Ubuntu SMP Mon Feb 12 21:23:04 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
RAM 2GB
CPU: 4 threads
data : /dev/vda 10GB ext4
leofs version: 1.3.8-1
Erlang version: Erlang/OTP 19 [erts-8.3.5.2] [source] [64-bit] [smp:4:4] [async-threads:10] [kernel-poll:false]
Eshell V8.3.5.2

leofs-adm status

[System Confiuration]
-----------------------------------+----------
Item                              | Value
-----------------------------------+----------
Basic/Consistency level
-----------------------------------+----------
                    system version | 1.3.8
                        cluster Id | leofs_1
                             DC Id | dc_1
                    Total replicas | 3
          number of successes of R | 1
          number of successes of W | 2
          number of successes of D | 2
number of rack-awareness replicas | 0
                         ring size | 2^128
-----------------------------------+----------
Multi DC replication settings
-----------------------------------+----------
[mdcr] max number of joinable DCs | 2
[mdcr] total replicas per a DC    | 1
[mdcr] number of successes of R   | 1
[mdcr] number of successes of W   | 1
[mdcr] number of successes of D   | 1
-----------------------------------+----------
Manager RING hash
-----------------------------------+----------
                 current ring-hash | 6f7e2a2e
                previous ring-hash | 6f7e2a2e
-----------------------------------+----------

[State of Node(s)]
-------+----------------------------+--------------+----------------+----------------+----------------------------
type |            node            |    state     | current ring |   prev ring    |          updated at
-------+----------------------------+--------------+----------------+----------------+----------------------------
S    | stor...@172.17.3.xx      | running      | 6f7e2a2e       | 6f7e2a2e       | 2018-03-23 11:45:50 +0200
S    | stor...@172.17.3.xx      | running      | 6f7e2a2e       | 6f7e2a2e       | 2018-03-23 11:46:30 +0200
S    | stor...@172.17.3.xx      | running      | 6f7e2a2e       | 6f7e2a2e       | 2018-03-23 12:11:28 +0200
G    | gate...@172.17.3.xx      | running      | 6f7e2a2e       | 6f7e2a2e       | 2018-03-23 09:20:27 +0200
-------+----------------------------+--------------+----------------+----------------+----------------------------

LOG:

when I stop and start leofs-storage

crash.log
-------------

2018-03-27 12:12:06 =SUPERVISOR REPORT====
     Supervisor: {local,leo_storage_sup}
     Context:    child_terminated
     Reason:     shutdown
     Offender:   [{pid,<0.541.0>},{id,leo_storage_handler_del_directory},{mfargs,{leo_storage_handler_del_directory,start_link,[]}},{restart_type,permanent},{shutdown,2000},{child_type,worker}]

2018-03-27 12:12:06 =ERROR REPORT====
{module,"leo_backend_db_eleveldb"},{function,"first_n/2"},{line,290},{body,{badarg,[{eleveldb,async_iterator,[#Ref<0.0.28573697.60673>,<<>>,[]],[]},{eleveldb,iterator,2,[{file,"src/eleveldb.erl"},{line,200}]},{leo
_backend_db_eleveldb,fold,4,[{file,"src/leo_backend_db_eleveldb.erl"},{line,383}]},{leo_backend_db_eleveldb,first_n,3,[{file,"src/leo_backend_db_eleveldb.erl"},{line,281}]},{leo_backend_db_server,handle_call,3,[{f
ile,"src/leo_backend_db_server.erl"},{line,338}]},{gen_server,try_handle_call,4,[{file,"gen_server.erl"},{line,615}]},{gen_server,handle_msg,5,[{file,"gen_server.erl"},{line,647}]},{proc_lib,init_p_do_apply,3,[{fi
le,"proc_lib.erl"},{line,247}]}]}}
2018-03-27 12:12:06 =ERROR REPORT====
{module,"leo_mq_server"},{function,"handle_call/3"},{line,293},{body,{badarg,[{eleveldb,async_iterator,[#Ref<0.0.28573697.60673>,<<>>,[]],[]},{eleveldb,iterator,2,[{file,"src/eleveldb.erl"},{line,200}]},{leo_backe
nd_db_eleveldb,fold,4,[{file,"src/leo_backend_db_eleveldb.erl"},{line,383}]},{leo_backend_db_eleveldb,first_n,3,[{file,"src/leo_backend_db_eleveldb.erl"},{line,281}]},{leo_backend_db_server,handle_call,3,[{file,"s
rc/leo_backend_db_server.erl"},{line,338}]},{gen_server,try_handle_call,4,[{file,"gen_server.erl"},{line,615}]},{gen_server,handle_msg,5,[{file,"gen_server.erl"},{line,647}]},{proc_lib,init_p_do_apply,3,[{file,"pr
oc_lib.erl"},{line,247}]}]}}

error.log
------------

[E]     stor...@172.17.3.17   2018-03-27 12:12:06.186947 +0200        1522145526      null:null       0       Supervisor leo_storage_sup had child leo_storage_handler_del_directory started with leo_storage_handl
er_del_directory:start_link() at <0.541.0> exit with reason shutdown in context child_terminated
[E]     stor...@172.17.3.17   2018-03-27 12:12:06.242671 +0200        1522145526      null:null       0       {module,"leo_backend_db_eleveldb"},{function,"first_n/2"},{line,290},{body,{badarg,[{eleveldb,async_i
terator,[#Ref<0.0.28573697.60673>,<<>>,[]],[]},{eleveldb,iterator,2,[{file,"src/eleveldb.erl"},{line,200}]},{leo_backend_db_eleveldb,fold,4,[{file,"src/leo_backend_db_eleveldb.erl"},{line,383}]},{leo_backend_db_el
eveldb,first_n,3,[{file,"src/leo_backend_db_eleveldb.erl"},{line,281}]},{leo_backend_db_server,handle_call,3,[{file,"src/leo_backend_db_server.erl"},{line,338}]},{gen_server,try_handle_call,4,[{file,"gen_server.er
l"},{line,615}]},{gen_server,handle_msg,5,[{file,"gen_server.erl"},{line,647}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,247}]}]}}
[E]     stor...@172.17.3.17   2018-03-27 12:12:06.243218 +0200        1522145526      null:null       0       {module,"leo_mq_server"},{function,"handle_call/3"},{line,293},{body,{badarg,[{eleveldb,async_iterato
r,[#Ref<0.0.28573697.60673>,<<>>,[]],[]},{eleveldb,iterator,2,[{file,"src/eleveldb.erl"},{line,200}]},{leo_backend_db_eleveldb,fold,4,[{file,"src/leo_backend_db_eleveldb.erl"},{line,383}]},{leo_backend_db_eleveldb
,first_n,3,[{file,"src/leo_backend_db_eleveldb.erl"},{line,281}]},{leo_backend_db_server,handle_call,3,[{file,"src/leo_backend_db_server.erl"},{line,338}]},{gen_server,try_handle_call,4,[{file,"gen_server.erl"},{l
ine,615}]},{gen_server,handle_msg,5,[{file,"gen_server.erl"},{line,647}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,247}]}]}}

Dňa utorok, 27. marca 2018 7:53:44 UTC+2 mocchira napísal(-a):

Martin

unread,

Mar 27, 2018, 9:06:47 AM3/27/18

to LeoProject.LeoFS

UPDATE:

I successfully reproduce this issue with DragonDisk 1.05 revision 565, Qt version 4.6.3

When upload ubuntu-16.04.4-server-amd64.iso to bucket and overwrite again ( 1.7 GB on each storage ) than I click right button and delete file from bucket.
Then run command leofs-adm compact-start stor...@172.17.3.xx all . Used space of each node are 865MB not zero.
I check leofs-adm whereis with empty results.

Maybe apps issue?

Thanks

Dňa utorok, 27. marca 2018 12:17:44 UTC+2 Martin napísal(-a):

mocchira

unread,

Mar 28, 2018, 1:57:38 AM3/28/18

to LeoProject.LeoFS

Thanks for the additional info.

We've succeeded in reproducing and now the fix is about to be merged into the main branch (review is in progress)

For more information: https://github.com/leo-project/leofs/issues/1011

The upcoming release 1.4.0 will be landed on today (or tomorrow) and the fix will be included in which so please give it a try once 1.4.0 get released.

Best,

Kanno.

2018年3月27日火曜日 22時06分47秒 UTC+9 Martin:

Martin

unread,

Apr 3, 2018, 8:33:11 AM4/3/18

to LeoProject.LeoFS

Hello,

I perform an upgrade from leofs 1.3.8 to 1.4.0 and try it copy image ubuntu-16.04.4-server-amd64.iso to bucket twice again.
But unfortunately after delete file from bucket still used space 865MB remaining on disk ( upload/delete done with DragonDisk 1.05 revision 565, Qt version 4.6.3).

1. first upload whereis - has children true

-------+----------------------------+--------------------------------------+------------+--------------+----------------+----------------+----------------+----------------------------
del? | node | ring address | size | checksum | has children | total chunks | clock | when
-------+----------------------------+--------------------------------------+------------+--------------+----------------+----------------+----------------+----------------------------

2. second upload ( overwrite file ) - has children false

s3@leofs-monitor-master:~$ leofs-adm whereis email/ubuntu-16.04.4-server-amd64.iso

-------+----------------------------+--------------------------------------+------------+--------------+----------------+----------------+----------------+----------------------------
del? | node | ring address | size | checksum | has children | total chunks | clock | when
-------+----------------------------+--------------------------------------+------------+--------------+----------------+----------------+----------------+----------------------------

       | stor...@172.17.3.XX      | bb70bc3bb3741034064757fc4cf2c7a9     |       432B |   9da8469c14 | false          |              0 | 568f09c78a072 | 2018-04-03 14:11:50 +0200
       | stor...@172.17.3.XX     | bb70bc3bb3741034064757fc4cf2c7a9     |       432B |   9da8469c14 | false          |              0 | 568f09c78a072 | 2018-04-03 14:11:50 +0200
       | stor...@172.17.3.XX     | bb70bc3bb3741034064757fc4cf2c7a9     |       432B |   9da8469c14 | false          |              0 | 568f09c78a072 | 2018-04-03 14:11:50 +0200

3. after delete from DragonDisk

s3@leofs-monitor-master:~$ leofs-adm whereis email/ubuntu-16.04.4-server-amd64.iso

-------+----------------------------+--------------------------------------+------------+--------------+----------------+----------------+----------------+----------------------------
del? | node | ring address | size | checksum | has children | total chunks | clock | when
-------+----------------------------+--------------------------------------+------------+--------------+----------------+----------------+----------------+----------------------------

*    | stor...@172.17.3.XX     | bb70bc3bb3741034064757fc4cf2c7a9     |         0B |   d41d8cd98f | false          |              0 | 568f0a002902b | 2018-04-03 14:12:49 +0200
*    | stor...@172.17.3.XX     | bb70bc3bb3741034064757fc4cf2c7a9     |         0B |   d41d8cd98f | false          |              0 | 568f0a002902b | 2018-04-03 14:12:49 +0200
*    | stor...@172.17.3.XX     | bb70bc3bb3741034064757fc4cf2c7a9     |         0B |   d41d8cd98f | false          |              0 | 568f0a002902b | 2018-04-03 14:12:49 +0200

4. after compaction

s3@leofs-monitor-master:~$ leofs-adm whereis email/ubuntu-16.04.4-server-amd64.iso

5. dignose storage before delete/compaction

194     48654293652169472977219967413208134243 email/ubuntu-16.04.4-server-amd64.iso   3       5242880 1522757386773633        2018-04-03 14:09:46 +0200       0
5243249 18630662154225910950113868836693423633 email/ubuntu-16.04.4-server-amd64.iso   14      5242880 1522757387647848        2018-04-03 14:09:47 +0200       0
10486305        1305587856473053440725201131567519039   email/ubuntu-16.04.4-server-amd64.iso   28      5242880 1522757388763384        2018-04-03 14:09:48 +0200       0
15729361        86479128561160137101466512302604490382 email/ubuntu-16.04.4-server-amd64.iso   37      5242880 1522757389404638        2018-04-03 14:09:49 +0200       0
20972417        136391237899058502250970511668661014833 email/ubuntu-16.04.4-server-amd64.iso   32      5242880 1522757389012778        2018-04-03 14:09:48 +0200       0
26215473        62735889023131669763489068514760227236 email/ubuntu-16.04.4-server-amd64.iso   73      5242880 1522757392105287        2018-04-03 14:09:52 +0200       0
31458529        137995823404141661210201733245139552832 email/ubuntu-16.04.4-server-amd64.iso   82      5242880 1522757392803705        2018-04-03 14:09:52 +0200       0
36701585        177198685779007107332347999341875637742 email/ubuntu-16.04.4-server-amd64.iso   81      5242880 1522757392734730        2018-04-03 14:09:52 +0200       0
41944641        271751427032166664349064659662183176917 email/ubuntu-16.04.4-server-amd64.iso   84      5242880 1522757393028276        2018-04-03 14:09:52 +0200       0
47187697        230684090163097641573923035431185089086 email/ubuntu-16.04.4-server-amd64.iso   93      5242880 1522757393609511        2018-04-03 14:09:53 +0200       0
52430753        91332420804438844921476576018367623451 email/ubuntu-16.04.4-server-amd64.iso   104     5242880 1522757394467711        2018-04-03 14:09:54 +0200       0
57673810        84525026973058920673781891713644762726 email/ubuntu-16.04.4-server-amd64.iso   114     5242880 1522757395319489        2018-04-03 14:09:55 +0200       0
62916867        128551868757200578465765762755348750987 email/ubuntu-16.04.4-server-amd64.iso   118     5242880 1522757395509842        2018-04-03 14:09:55 +0200       0
68159924        119126287842170527518048145358222891806 email/ubuntu-16.04.4-server-amd64.iso   119     5242880 1522757395622814        2018-04-03 14:09:55 +0200       0
73402981        106820903037813120111998310676366237888 email/ubuntu-16.04.4-server-amd64.iso   126     5242880 1522757396101076        2018-04-03 14:09:56 +0200       0
78646038        252199134750526095213746118183585323930 email/ubuntu-16.04.4-server-amd64.iso   133     5242880 1522757396749897        2018-04-03 14:09:56 +0200       0
83889095        279088278880134321869545830129770895782 email/ubuntu-16.04.4-server-amd64.iso   136     5242880 1522757396828933        2018-04-03 14:09:56 +0200       0
89132152        102157889517908859307174856038327939204 email/ubuntu-16.04.4-server-amd64.iso   141     5242880 1522757397214268        2018-04-03 14:09:57 +0200       0
94375209        79110484736612490901564643050933487127 email/ubuntu-16.04.4-server-amd64.iso   147     5242880 1522757397661267        2018-04-03 14:09:57 +0200       0
99618266        73866244164897303981551779577716780154 email/ubuntu-16.04.4-server-amd64.iso   158     5242880 1522757398505832        2018-04-03 14:09:58 +0200       0
104861323       14347049872946797675293603177765070346 email/ubuntu-16.04.4-server-amd64.iso   162     5242880 1522757398748294        2018-04-03 14:09:58 +0200       0
110104380       51541091414224355007301402500847654876 email/ubuntu-16.04.4-server-amd64.iso   168     5242880 1522757399175055        2018-04-03 14:09:59 +0200       0
115347437       48654293652169472977219967413208134243 email/ubuntu-16.04.4-server-amd64.iso   3       5242880 1522757498961108        2018-04-03 14:11:38 +0200       0
120590492       18630662154225910950113868836693423633 email/ubuntu-16.04.4-server-amd64.iso   14      5242880 1522757499799055        2018-04-03 14:11:39 +0200       0
125833548       1305587856473053440725201131567519039   email/ubuntu-16.04.4-server-amd64.iso   28      5242880 1522757500794854        2018-04-03 14:11:40 +0200       0
131076604       136391237899058502250970511668661014833 email/ubuntu-16.04.4-server-amd64.iso   32      5242880 1522757500918659        2018-04-03 14:11:40 +0200       0
136319660       86479128561160137101466512302604490382 email/ubuntu-16.04.4-server-amd64.iso   37      5242880 1522757501173117        2018-04-03 14:11:41 +0200       0
141562716       62735889023131669763489068514760227236 email/ubuntu-16.04.4-server-amd64.iso   73      5242880 1522757503351817        2018-04-03 14:11:43 +0200       0
146805772       137995823404141661210201733245139552832 email/ubuntu-16.04.4-server-amd64.iso   82      5242880 1522757503844556        2018-04-03 14:11:43 +0200       0
152048828       271751427032166664349064659662183176917 email/ubuntu-16.04.4-server-amd64.iso   84      5242880 1522757504067907        2018-04-03 14:11:43 +0200       0
157291884       177198685779007107332347999341875637742 email/ubuntu-16.04.4-server-amd64.iso   81      5242880 1522757503811015        2018-04-03 14:11:43 +0200       0
162534940       91332420804438844921476576018367623451 email/ubuntu-16.04.4-server-amd64.iso   104     5242880 1522757505142632        2018-04-03 14:11:45 +0200       0
167777997       84525026973058920673781891713644762726 email/ubuntu-16.04.4-server-amd64.iso   114     5242880 1522757505790782        2018-04-03 14:11:45 +0200       0
173021054       106820903037813120111998310676366237888 email/ubuntu-16.04.4-server-amd64.iso   126     5242880 1522757506373800        2018-04-03 14:11:46 +0200       0
178264111       252199134750526095213746118183585323930 email/ubuntu-16.04.4-server-amd64.iso   133     5242880 1522757506953433        2018-04-03 14:11:46 +0200       0
183507168       102157889517908859307174856038327939204 email/ubuntu-16.04.4-server-amd64.iso   141     5242880 1522757507306920        2018-04-03 14:11:47 +0200       0
188750225       79110484736612490901564643050933487127 email/ubuntu-16.04.4-server-amd64.iso   147     5242880 1522757507824556        2018-04-03 14:11:47 +0200       0
193993282       73866244164897303981551779577716780154 email/ubuntu-16.04.4-server-amd64.iso   158     5242880 1522757508364739        2018-04-03 14:11:48 +0200       0
199236339       230684090163097641573923035431185089086 email/ubuntu-16.04.4-server-amd64.iso   93      5242880 1522757504474200        2018-04-03 14:11:44 +0200       0
204479395       119126287842170527518048145358222891806 email/ubuntu-16.04.4-server-amd64.iso   119     5242880 1522757506054880        2018-04-03 14:11:45 +0200       0
209722452       14347049872946797675293603177765070346 email/ubuntu-16.04.4-server-amd64.iso   162     5242880 1522757508561264        2018-04-03 14:11:48 +0200       0
214965509       128551868757200578465765762755348750987 email/ubuntu-16.04.4-server-amd64.iso   118     5242880 1522757505929515        2018-04-03 14:11:45 +0200       0
220208566       279088278880134321869545830129770895782 email/ubuntu-16.04.4-server-amd64.iso   136     5242880 1522757507029236        2018-04-03 14:11:46 +0200       0
225451623       51541091414224355007301402500847654876 email/ubuntu-16.04.4-server-amd64.iso   168     5242880 1522757509081722        2018-04-03 14:11:48 +0200       0

6. diagnose storage after delete/compaction

194     48654293652169472977219967413208134243 email/ubuntu-16.04.4-server-amd64.iso   3       5242880 1522757498961108        2018-04-03 14:11:38 +0200       0
5243249 18630662154225910950113868836693423633 email/ubuntu-16.04.4-server-amd64.iso   14      5242880 1522757499799055        2018-04-03 14:11:39 +0200       0
10486305        1305587856473053440725201131567519039   email/ubuntu-16.04.4-server-amd64.iso   28      5242880 1522757500794854        2018-04-03 14:11:40 +0200       0
15729361        136391237899058502250970511668661014833 email/ubuntu-16.04.4-server-amd64.iso   32      5242880 1522757500918659        2018-04-03 14:11:40 +0200       0
20972417        86479128561160137101466512302604490382 email/ubuntu-16.04.4-server-amd64.iso   37      5242880 1522757501173117        2018-04-03 14:11:41 +0200       0
26215473        62735889023131669763489068514760227236 email/ubuntu-16.04.4-server-amd64.iso   73      5242880 1522757503351817        2018-04-03 14:11:43 +0200       0
31458529        137995823404141661210201733245139552832 email/ubuntu-16.04.4-server-amd64.iso   82      5242880 1522757503844556        2018-04-03 14:11:43 +0200       0
36701585        271751427032166664349064659662183176917 email/ubuntu-16.04.4-server-amd64.iso   84      5242880 1522757504067907        2018-04-03 14:11:43 +0200       0
41944641        177198685779007107332347999341875637742 email/ubuntu-16.04.4-server-amd64.iso   81      5242880 1522757503811015        2018-04-03 14:11:43 +0200       0
47187697        91332420804438844921476576018367623451 email/ubuntu-16.04.4-server-amd64.iso   104     5242880 1522757505142632        2018-04-03 14:11:45 +0200       0
52430754        84525026973058920673781891713644762726 email/ubuntu-16.04.4-server-amd64.iso   114     5242880 1522757505790782        2018-04-03 14:11:45 +0200       0
57673811        106820903037813120111998310676366237888 email/ubuntu-16.04.4-server-amd64.iso   126     5242880 1522757506373800        2018-04-03 14:11:46 +0200       0
62916868        252199134750526095213746118183585323930 email/ubuntu-16.04.4-server-amd64.iso   133     5242880 1522757506953433        2018-04-03 14:11:46 +0200       0
68159925        102157889517908859307174856038327939204 email/ubuntu-16.04.4-server-amd64.iso   141     5242880 1522757507306920        2018-04-03 14:11:47 +0200       0
73402982        79110484736612490901564643050933487127 email/ubuntu-16.04.4-server-amd64.iso   147     5242880 1522757507824556        2018-04-03 14:11:47 +0200       0
78646039        73866244164897303981551779577716780154 email/ubuntu-16.04.4-server-amd64.iso   158     5242880 1522757508364739        2018-04-03 14:11:48 +0200       0
83889096        230684090163097641573923035431185089086 email/ubuntu-16.04.4-server-amd64.iso   93      5242880 1522757504474200        2018-04-03 14:11:44 +0200       0
89132152        119126287842170527518048145358222891806 email/ubuntu-16.04.4-server-amd64.iso   119     5242880 1522757506054880        2018-04-03 14:11:45 +0200       0
94375209        14347049872946797675293603177765070346 email/ubuntu-16.04.4-server-amd64.iso   162     5242880 1522757508561264        2018-04-03 14:11:48 +0200       0
99618266        128551868757200578465765762755348750987 email/ubuntu-16.04.4-server-amd64.iso   118     5242880 1522757505929515        2018-04-03 14:11:45 +0200       0
104861323       279088278880134321869545830129770895782 email/ubuntu-16.04.4-server-amd64.iso   136     5242880 1522757507029236        2018-04-03 14:11:46 +0200       0
110104380       51541091414224355007301402500847654876 email/ubuntu-16.04.4-server-amd64.iso   168     5242880 1522757509081722        2018-04-03 14:11:48 +0200       0

Dňa streda, 28. marca 2018 7:57:38 UTC+2 mocchira napísal(-a):

mocchira

unread,

Apr 4, 2018, 8:40:56 PM4/4/18

to LeoProject.LeoFS

Hello Martin,

Thanks for confirming with 1.4.0.

> I perform an upgrade from leofs 1.3.8 to 1.4.0 and try it copy image ubuntu-16.04.4-server-amd64.iso to bucket twice again.
> But unfortunately after delete file from bucket still used space 865MB remaining on disk ( upload/delete done with DragonDisk 1.05 revision 565, Qt version 4.6.3).

Reproduced.

As you mentioned at a previous mail, this issue can be caused ONLY by DragonDisk.

(Technically that can be caused by other S3 clients using the PUT Object acl request but fortunately have not confirmed yet)

The detail can be found on https://github.com/leo-project/leofs/issues/1021.

The fix has already been merged into the main branch so which will be released within 2 weeks so give it another try with 1.4.1 once that come out.

For now I'd recommend you use other s3 tools like s3cmd with 1.4.0.

Best,

Kanno.

2018年4月3日火曜日 21時33分11秒 UTC+9 Martin:

mocchira

unread,

Apr 25, 2018, 1:36:38 AM4/25/18

to LeoProject.LeoFS

Hello Martin,

Just in case, I'd like to tell you 1.4.1 has been released just now so give it another try when you have time.