Can't create Virtualbox VDI on sdfs-volume. Possible?

37 views
Skip to first unread message

Mikael Östergren

unread,
Nov 7, 2019, 6:26:25 PM11/7/19
to dedupfilesystem-sdfs-user-discuss
Hi,

I hope can provide some useful info here.

Windows 10 1903 (latest and greatest). Virtualbox also latest.
Java (build 1.8.0_221-b11)

I've created a volume 100GB for test.

I'm trying to create a virtual machine on the sdfs volume. Should it be possible?

Get this in the log when I try (I've reduceed the size of the log, cutting out some noise only). Included the error from Virtualbox and some more info --debug-info and --volume-info at the bottom.

***** SDFS log:

2019-11-06 13:12:56,580 [INFO] [sdfs] [org.opendedup.sdfs.Config] [248] [main]  - ############ Running SDFS Version 3.7.8
2019-11-06 13:12:56,586 [INFO] [sdfs] [org.opendedup.sdfs.Config] [267] [main]  - Parsing volume subsystem-config version 3.7.8
2019-11-06 13:12:56,586 [INFO] [sdfs] [org.opendedup.sdfs.Config] [269] [main]  - parsing folder locations
2019-11-06 13:12:56,586 [INFO] [sdfs] [org.opendedup.sdfs.Config] [301] [main]  - Setting hash engine to VARIABLE_MD5
2019-11-06 13:12:56,589 [INFO] [sdfs] [org.opendedup.hashing.HashFunctionPool] [72] [main]  - Set hashtype to VARIABLE_MD5 hash length = 16 maxhashcluster= 64 chunk-length=262144 minlen=4095
2019-11-06 13:12:56,592 [INFO] [sdfs] [org.opendedup.sdfs.io.Volume] [276] [main]  - Mounting volume C:\prg\sys\sdfs\volumes\sdfs_vol1\files
2019-11-06 13:12:56,595 [INFO] [sdfs] [org.opendedup.sdfs.io.Volume] [355] [main]  - Volume write threshold is 0.95
2019-11-06 13:12:56,595 [INFO] [sdfs] [org.opendedup.sdfs.io.Volume] [371] [main]  - Setting volume size to 107374182400
2019-11-06 13:12:56,595 [INFO] [sdfs] [org.opendedup.sdfs.io.Volume] [373] [main]  - Setting maximum capacity to 102005473280
2019-11-06 13:12:56,633 [INFO] [sdfs] [org.opendedup.sdfs.Config] [411] [main]  - ######### Will allocate 107374182400 in chunkstore ##############
2019-11-06 13:12:56,634 [INFO] [sdfs] [org.opendedup.sdfs.Config] [493] [main]  - ################## Encryption is NOT enabled ##################
2019-11-06 13:12:57,244 [INFO] [sdfs] [org.opendedup.sdfs.servers.SDFSService] [82] [main]  - HashFunction Min Block Size=4095 Max Block Size=32768
2019-11-06 13:12:57,244 [INFO] [sdfs] [org.opendedup.sdfs.servers.HCServiceProxy] [152] [main]  - Starting local chunkstore
2019-11-06 13:12:57,261 [INFO] [sdfs] [org.opendedup.hashing.VariableMD5HashEngine] [47] [main]  - Variable minLen=4095 maxlen=32768 windowSize=48
2019-11-06 13:12:57,955 [INFO] [sdfs] [org.opendedup.sdfs.filestore.HashBlobArchive] [304] [main]  - ############################ Initialied HashBlobArchive ##############################
2019-11-06 13:12:57,955 [INFO] [sdfs] [org.opendedup.sdfs.filestore.HashBlobArchive] [305] [main]  - Version : 0
2019-11-06 13:12:57,957 [INFO] [sdfs] [org.opendedup.sdfs.filestore.HashBlobArchive] [306] [main]  - HashBlobArchive IO Threads : 16
2019-11-06 13:12:57,957 [INFO] [sdfs] [org.opendedup.sdfs.filestore.HashBlobArchive] [307] [main]  - HashBlobArchive Max Upload Size : 62914560
2019-11-06 13:12:57,957 [INFO] [sdfs] [org.opendedup.sdfs.filestore.HashBlobArchive] [312] [main]  - HashBlobArchive Max Map Size : 25605
2019-11-06 13:12:57,957 [INFO] [sdfs] [org.opendedup.sdfs.filestore.HashBlobArchive] [313] [main]  - HashBlobArchive Maximum Local Cache Size : 10737418240
2019-11-06 13:12:57,957 [INFO] [sdfs] [org.opendedup.sdfs.filestore.HashBlobArchive] [314] [main]  - HashBlobArchive Max Thread Sleep Time : 1500
2019-11-06 13:12:57,957 [INFO] [sdfs] [org.opendedup.sdfs.filestore.HashBlobArchive] [315] [main]  - HashBlobArchive Spool Directory : C:\prg\sys\sdfs\volumes\sdfs_vol1\chunkstore\chunks
2019-11-06 13:12:57,957 [INFO] [sdfs] [org.opendedup.sdfs.filestore.HashBlobArchive] [316] [main]  - HashBlobArchive Queue Size : 0
2019-11-06 13:12:58,481 [INFO] [sdfs] [org.opendedup.sdfs.filestore.HashBlobArchive] [548] [main]  - ################################# Done Uploading Archives #################
2019-11-06 13:12:58,483 [INFO] [sdfs] [org.opendedup.hashing.VariableMD5HashEngine] [47] [main]  - Variable minLen=4095 maxlen=32768 windowSize=48
2019-11-06 13:12:58,956 [INFO] [sdfs] [org.opendedup.sdfs.filestore.HashStore] [175] [main]  - Loading hashdb class org.opendedup.collections.RocksDBMap
2019-11-06 13:12:58,956 [INFO] [sdfs] [org.opendedup.sdfs.filestore.HashStore] [177] [main]  - Maximum Number of Entries is 13115200
2019-11-06 13:12:58,961 [INFO] [sdfs] [org.opendedup.collections.RocksDBMap] [102] [main]  - jni libpath = C:\prg\sys\sdfs\bin\2012
2019-11-06 13:12:58,974 [INFO] [sdfs] [org.opendedup.collections.RocksDBMap] [128] [main]  - Setting up Small Hash Table
2019-11-06 13:12:58,974 [INFO] [sdfs] [org.opendedup.collections.RocksDBMap] [153] [main]  - mem=13115200 memperDB=1639400 bufferSize=1073741824 bufferSizePerDB=134217728
2019-11-06 13:12:59,131 [INFO] [sdfs] [org.opendedup.sdfs.filestore.HashStore] [88] [main]  - Cache Size = 262144
2019-11-06 13:12:59,131 [INFO] [sdfs] [org.opendedup.sdfs.filestore.HashStore] [89] [main]  - Total Entries 0
2019-11-06 13:12:59,131 [INFO] [sdfs] [org.opendedup.sdfs.filestore.HashStore] [90] [main]  - Added sdfs
2019-11-06 13:12:59,132 [WARN] [sdfs] [org.opendedup.sdfs.servers.HCServiceProxy] [377] [main]  - Write lock file C:\prg\sys\sdfs\volumes\sdfs_vol1\chunkstore\hdb-3092603615717529563\.lock
2019-11-06 13:12:59,388 [INFO] [sdfs] [org.opendedup.util.KeyGenerator] [87] [main]  - generated certificate for ssl communication at C:\prg\sys\sdfs\volumes\sdfs_vol1\keys\volume.keystore
2019-11-06 13:12:59,511 [INFO] [sdfs] [org.opendedup.hashing.VariableMD5HashEngine] [47] [main]  - Variable minLen=4095 maxlen=32768 windowSize=48
2019-11-06 13:12:59,997 [INFO] [sdfs] [org.opendedup.sdfs.mgmt.Io] [75] [main]  - mounting C:\prg\sys\sdfs\volumes\sdfs_vol1\files to S
2019-11-06 13:13:00,076 [INFO] [sdfs] [org.opendedup.sdfs.mgmt.MgmtWebServer] [1295] [main]  - ###################### SDFSCLI SSL Management WebServer Started at localhost/127.0.0.1:6442 #########################
2019-11-06 13:13:00,078 [INFO] [sdfs] [org.opendedup.sdfs.filestore.gc.PFullGC] [48] [main]  - Current DSE Percentage Full is [0.0] will run GC when [10.0]
2019-11-06 13:13:00,078 [INFO] [sdfs] [org.opendedup.sdfs.filestore.gc.StandAloneGCScheduler] [39] [main]  - Using org.opendedup.sdfs.filestore.gc.PFullGC for DSE Garbage Collection
2019-11-06 13:13:00,078 [INFO] [sdfs] [org.opendedup.sdfs.filestore.gc.StandAloneGCScheduler] [48] [main]  - GC Thread priority is 10
2019-11-06 13:13:00,080 [INFO] [sdfs] [org.opendedup.sdfs.filestore.gc.SDFSGCScheduler] [45] [main]  - Scheduling FDISK Jobs for SDFS
2019-11-06 13:13:00,108 [INFO] [org.quartz.impl.StdSchedulerFactory] [org.quartz.impl.StdSchedulerFactory] [1179] [main]  - Using default implementation for ThreadExecutor
2019-11-06 13:13:00,119 [INFO] [org.quartz.core.SchedulerSignalerImpl] [org.quartz.core.SchedulerSignalerImpl] [60] [main]  - Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl
2019-11-06 13:13:00,119 [INFO] [org.quartz.core.QuartzScheduler] [org.quartz.core.QuartzScheduler] [229] [main]  - Quartz Scheduler v.1.8.6 created.
2019-11-06 13:13:00,120 [INFO] [org.quartz.simpl.RAMJobStore] [org.quartz.simpl.RAMJobStore] [139] [main]  - RAMJobStore initialized.
2019-11-06 13:13:00,121 [INFO] [org.quartz.core.QuartzScheduler] [org.quartz.core.QuartzScheduler] [255] [main]  - Scheduler meta-data: Quartz Scheduler (v1.8.6) 'QuartzScheduler' with instanceId 'NON_CLUSTERED'

[....]

2019-11-08 00:10:39,439 [INFO] [sdfs] [org.opendedup.sdfs.io.SparseDedupFile] [875] [pool-4-thread-8]  - Channel size is 0
2019-11-08 00:10:39,439 [INFO] [sdfs] [org.opendedup.sdfs.io.SparseDedupFile] [877] [pool-4-thread-8]  - Closinging C:\prg\sys\sdfs\volumes\sdfs_vol1\files\test\vm\Windows 10 dedup\Windows 10 dedup.vdi
2019-11-08 00:10:39,439 [INFO] [sdfs] [org.opendedup.collections.LongByteArrayMap] [894] [pool-4-thread-8]  - Opens for C:\prg\sys\sdfs\volumes\sdfs_vol1\ddb\02\023df78e-9be4-4f98-bca9-88e3cadc0728\023df78e-9be4-4f98-bca9-88e3cadc0728.map = 0
2019-11-08 00:10:39,455 [INFO] [sdfs] [org.opendedup.sdfs.io.SparseDedupFile] [875] [pool-4-thread-9]  - Channel size is 0
2019-11-08 00:10:39,455 [INFO] [sdfs] [org.opendedup.sdfs.io.SparseDedupFile] [877] [pool-4-thread-9]  - Closinging C:\prg\sys\sdfs\volumes\sdfs_vol1\files\test\vm\Windows 10 dedup\Windows 10 dedup.vdi
2019-11-08 00:10:39,455 [INFO] [sdfs] [org.opendedup.collections.LongByteArrayMap] [894] [pool-4-thread-9]  - Opens for C:\prg\sys\sdfs\volumes\sdfs_vol1\ddb\02\023df78e-9be4-4f98-bca9-88e3cadc0728\023df78e-9be4-4f98-bca9-88e3cadc0728.map = 0
2019-11-08 00:10:39,458 [INFO] [sdfs] [org.opendedup.sdfs.io.SparseDedupFile] [875] [pool-4-thread-8]  - Channel size is 0
2019-11-08 00:10:39,458 [INFO] [sdfs] [org.opendedup.sdfs.io.SparseDedupFile] [877] [pool-4-thread-8]  - Closinging C:\prg\sys\sdfs\volumes\sdfs_vol1\files\test\vm\Windows 10 dedup\Windows 10 dedup.vdi
2019-11-08 00:10:39,458 [INFO] [sdfs] [org.opendedup.collections.LongByteArrayMap] [894] [pool-4-thread-8]  - Opens for C:\prg\sys\sdfs\volumes\sdfs_vol1\ddb\02\023df78e-9be4-4f98-bca9-88e3cadc0728\023df78e-9be4-4f98-bca9-88e3cadc0728.map = 0
2019-11-08 00:10:39,460 [INFO] [sdfs] [org.opendedup.collections.LongByteArrayMap] [894] [pool-3-thread-5]  - Opens for C:\prg\sys\sdfs\volumes\sdfs_vol1\ddb\02\023df78e-9be4-4f98-bca9-88e3cadc0728\023df78e-9be4-4f98-bca9-88e3cadc0728.map = -1
2019-11-08 00:10:39,460 [ERROR] [fs] [org.opendedup.sdfs.windows.fs.WinSDFS] [624] [Thread-27]  - unable to delete file \test\vm\Windows 10 dedup\Windows 10 dedup.vdi
ERROR_FILE_NOT_FOUND
    at org.opendedup.sdfs.windows.fs.WinSDFS.resolvePath(WinSDFS.java:868)
    at org.opendedup.sdfs.windows.fs.WinSDFS.getFileChannel(WinSDFS.java:793)
    at org.opendedup.sdfs.windows.fs.WinSDFS$DeleteFileThread.run(WinSDFS.java:1112)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
------------------------------
***** Virtualbox log:
Could not create the medium storage unit 'S:\test\vm\Windows 10 dedup\Windows 10 dedup.vdi'.
VDI: setting image size failed for 'S:\test\vm\Windows 10 dedup\Windows 10 dedup.vdi' (VERR_INVALID_FUNCTION).

Result Code:
VBOX_E_FILE_ERROR (0x80BB0004)
Component:
MediumWrap
Interface:
IMedium {ad47ad09-787b-44ab-b343-a082a3f2dfb1}

------------------------------
More info:

C:\prg\sys\sdfs>sdfscli.exe --debug-info
Active SDFS Threads : 38
Free Disk Space for Chunk Store: 95,29 GB
Total Space for Chunk Store: 475,06 GB

C:\prg\sys\sdfs>sdfscli.exe --volume-info
Files : 15
Volume Capacity : 100 GB
Volume Current Logical Size : 33,99 GB
Volume Max Percentage Full : 95.0%
Volume Duplicate Data Written : 12,58 GB
Unique Blocks Stored: 21,41 GB
Unique Blocks Stored after Compression : 21,48 GB
Cluster Block Copies : 2
Volume Virtual Dedup Rate (Unique Blocks Stored/Current Size) : 37.0%
Volume Actual Storage Savings (Compressed Unique Blocks Stored/Current Size) : 36.81%
Compression Rate: -0.31%

Reply all
Reply to author
Forward
0 new messages