Qzip

0 views
Skip to first unread message

Giacometta Fritchman

unread,
Aug 5, 2024, 4:45:19 AM8/5/24
to tacurigle
Whichif someone (lazily) created a file using qCompress() you would need to write your own code to read the file as a QByteArray then use the corresponding qUncompress() method to read it. There is no official qzip format related to Qt that I know, so you should probably go and slap the developer who made these files if it works out!

Occasionally (approx 1 time in 20) the compression command creates a compressed file that can not be decompressed by qzip (QAT zip). The compressed file appears to be a valid archive because it can be decompressed by gzip (GNU zip) which results in a decompressed file that is identical to the original file.


Note: That we have successfully compressed and decompressed the exact same database.bak.5 file 19 times successfully.

Note: That the database.bak.5.gz file can be decompressed by gzip (GNU zip) which results in the exact same file as the original.

Note: We also have a RHEL 8.8 server were we see the same issue.


On the other hand, would you be willing to provide us with the file that cannot be decompressed? With Compress and Verify (CnV) this should not be possible as we are decompressing each block after compressing to ensure we can decompress the data. It would also be interesting to see if see any CnV errors being logged. We can check this with command similar to: cat /sys/kernel/debug/qat_4xxx_0000\:09\:00.0/cnv_errors (update the BDF to align with QAT endpoint on your system).


I have a case open with Red Hat. They have provided a copy of the RHEL 9.4.0 beta qatlib/qatlib-service/qatzip packages to install on RHEL8 to try out. qzip -V also returns v1.1.2 for this installation. These RHEL 9.4.0 beta packages also produce the same error.


I have had a look at the QATzip instructions from Git Hub. They look complex and I don't have the expertise to work out what is applicable on a RHEL8 system. I will ask Red Hat support to review and see if they can provide any guidance.


In all cases, you are using QATzip version v1.1.2, we still believe that testing the latest QATzip version 1.2.0 from _1.2.0_release may be very helpful in debugging this issue and finally, you mentioned that this error happens consistently for database.bak.5.gz file. Have you tried other files is do you still get error? I am trying to understand if this error is data dependent, application or hardware related.


I sent you an email with the instructions for you to have access to our SFTP. Additionally, I have initiated a password reset request on your behalf. You should receive an email shortly with instructions on how to reset your password.


I believe we have identified the root cause of the issue as a software decompression bug within the qzip utility. The problem arises when QZ_DATA_ERROR is returned after several successful executions of the doProcessBuffer() function, leading to an incorrect bytes_processed count. Consequently, the data input into the qzDecompress call lacks a valid GZip header, resulting in the error. It's important to note that this bug is not related to hardware compression/decompression and does not pose a risk of user data loss.


Intel does not verify all solutions, including but not limited to any file transfers that may appear in this community. Accordingly, Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade.


The first two characters of our name, Qz, is derived from Pure quartz, traditionally called rock crystal or clear quartz, is colorless and transparent or translucent. The next two characters, IP, stands for Intellectual Property.


Learn more about our business QzIP.business Mission Our mission is to help India accelerate towards transforming the economic pyramid into an economic diamond.

To know more about our mission; Please go to vision.qzip.business .

3a8082e126
Reply all
Reply to author
Forward
0 new messages