Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss

My Parallel Compression Library for Windows and Linux version 4.2 is here..

0 views
Skip to first unread message

Intelli2

unread,
Nov 18, 2017, 5:12:54 PM11/18/17
to
Hello...


My Parallel Compression Library for Windows and Linux version 4.2 is here..

I have enhanced my Parallel Compression Library, now the process of
calculating the CRC is much more optimized and fast, and the process of
testing the integrity is much more faster, also i have stress tested it
much more and i have found a bug that i have corrected, and now i think
that you can be more confident because it is much more stable and very fast.

Description:

Parallel Compression Library implements Parallel LZ4 , Parallel LZMA ,
and Parallel Zstd algorithms using my Thread Pool Engine.

- It supports memory streams, file streams and files

- 64 bit supports - lets you create archive files over 4 GB , supports
archives up to 2^63 bytes, compresses and decompresses files up to
2^63 bytes.

- Parallel compression and parallel decompression are extremely fast

- Now it supports processor groups on windows, so that it can use more
than 64 logical processors and it scales well.

- It's NUMA-aware and NUMA efficient on windows

- It minimizes efficiently the contention so that it scales well.

- It supports both compression and decompression rate indicator

- You can test the integrity of your compressed file or stream

- Easy programming interface

- Full source codes available.

Now my Parallel compression library is optimized for NUMA and it
supports processor groups on windows and it uses only two threads that
do the IO (and they are not contending) so that it reduces at best the
contention, so that it scales well.

Here are the parameters of the constructor:

First parameter is: The number of cores you have specify to run the
compression algorithm in parallel.

Second parameter is: A boolean parameter that is processorgroups to
support processor groups on windows , if it is set to true it will
enable you to scale beyond 64 logical processors and it will be NUMA
efficient.


You can download and read about my Parallel Compression Library from:

https://sites.google.com/site/aminer68/parallel-compression-library



Thank you,
Amine Moulay Ramdane.





0 new messages