xRITDecompress now open source

[Ernst Lobsiger]

Dear PyTROLL/Satpy developpers
Dear all

The wavelet decompression executable xRITDecompress is needed for processing Meteosat MSG
SEVIRI or Electro-L MSU-GS files. Until recently EUMETSAT has distributed xRITDecompress
as c++ source code after an individual registration and acceptance of a special license.
It was up to the user of PyTROLL/Satpy to get and install a working xRITDecompress(.exe).

Now the situation has quite changed as EUMETSAT has silently open sourced the code

https://gitlab.eumetsat.int/open-source/PublicDecompWT

and put it under the Apache License 2.0. The said code is easily compiled under
GNU/Linux 32Bit or 64Bit. It is out of reach of most Windows users to compile it.

On this list I have found one single hint that Diego Souza has possibly done so:
<cite>
\\xRITDecompress\\xRITDecompress_x64\\xRITDecompress.exe' > > # Create the global scene > global_scene = > Scene(reader='seviri_l1b_hrit',filenames...
</cite>

I attach a message I have sent to EUMETSAT OPS that discribes the actual situation.
With this wavelet decompression code now open sourced I can even imagine a complete
integration of the decompression into PyTROLL/Satpy distributed with pip and conda.

Let's wait what EUMETSAT will answer. Maybe they have a genuine Windows 10 64Bit
executable they are willing to share. If not we must prevent that everybody under
Windows has to try to reinvent the wheel. GNU/Linuxers will just use git and g++ :-).

What do the PyTROLL/Satpy developpers think?
Who has a clean Windows 10 solution already?


Best Regards
Ernst

[Martin Raspaud]

Dear Ernst,

Thank you very much for your initiative. It is indeed very important for
windows users to be able to decompress the data as well.

Now that the licence is GPL compatible, one possibility would be to
package the xrit decompress into a python module so that satpy (and
other python packages) would be able to use the compressed the data
seemlessly. If someone has time and motivation, that would be a great
project to work on.

But that of course means that the xRitDecompress could be compiled on
windows too.

Best regards,
Martin

> --
> You received this message because you are subscribed to the Google
> Groups "pytroll" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to pytroll+u...@googlegroups.com
> <mailto:pytroll+u...@googlegroups.com>.
> To view this discussion on the web, visit
> https://groups.google.com/d/msgid/pytroll/d1164c5e-2c2b-466f-8abf-c4b86be7e39c%40googlegroups.com
> <https://groups.google.com/d/msgid/pytroll/d1164c5e-2c2b-466f-8abf-c4b86be7e39c%40googlegroups.com?utm_medium=email&utm_source=footer>.

[Adam Dybbroe]

Ernst,

Thanks a lot for this initiative, that is most appreciated. And I agree with Martin, an integration into Satpy/Pytroll would be great.

I am keen to see the response from EUMETSAT, please share that with us once you get something.

-Adam

--
You received this message because you are subscribed to the Google Groups "pytroll" group.

To unsubscribe from this group and stop receiving emails from it, send an email to pytroll+u...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/pytroll/d1164c5e-2c2b-466f-8abf-c4b86be7e39c%40googlegroups.com.

-- 
Adam Dybbroe,
Satellite Remote Sensing Scientist,
Atmospheric Research unit, Research and Development
Swedish Meteorological and Hydrological Institute (SMHI)
www.pytroll.org
nwcsaf.smhi.se
www.smhi.se

[Ernst Lobsiger]

Dear All

It's now 14 days I sent my message regarding xRITDecompress.exe to OPS. I have had no reply or
even confirmation that they received my mail and are considering the issue. But when I go to
the software delivery page or product navigator I notice that they have now changed the text:

https://www.eumetsat.int/website/home/Data/DataDelivery/Software/index.html

https://navigator.eumetsat.int/product/EO:EUM:SW:MSG:153

<cite>
The Wavelet Transform Software is the decompression software used to decompress SEVIRI High Rate
Information Transmission (HRIT) and Foreign Satellite data files. The software is compilable on
Microsoft Windows, Linux and Solaris Operating Systems, and it works on 32 bits and 64 bits, as
well as mixed architectures. On Windows, it can be compiled using Eclipse or Cygwin.
</cite>

It seems that this significant change is a result of my initiative but I have no proof so far.

Meanwhile I have managed to compile xRITDecompress.exe on Windows 7 (32Bit) and Windows 10 (64Bit)
using Cygwin. To make it run without a Cygwin environment it needs 3 *.dll from the Cygwin distro.

A working 64Bit version is part of my "Pytroll/Satpy EUMETCast for Windows Starter Kit". See here:

https://groups.io/g/MSG-1/message/29367

I have also tried different versions of mingw-w64 (cross-) compilers under GNU/Linux and Windows 10
without real success. I am no C++ programmer and I do not want to fool around with the code too much.

Best Regards
Ernst

[David Hoese]

Ernst,

FYI Dan Lee who is currently maintaining the xRITDecompress tool and
made it open source is on the Pytroll slack. If you'd like to join that,
it may be the easiest way to talk to him apart from making an issue on
the xRITDecompress repository.

Thanks for the update regardless.

Dave

> --
> You received this message because you are subscribed to the Google
> Groups "pytroll" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to pytroll+u...@googlegroups.com

> <mailto:pytroll+u...@googlegroups.com>.

> To view this discussion on the web, visit

> https://groups.google.com/d/msgid/pytroll/ba9937e4-883b-40db-9bae-f4e945dab872%40googlegroups.com
> <https://groups.google.com/d/msgid/pytroll/ba9937e4-883b-40db-9bae-f4e945dab872%40googlegroups.com?utm_medium=email&utm_source=footer>.

[Ernst Lobsiger]

Dave,

to be honest slack is not for me. I'm learning git at the CLI right now and have

the e-mail address of Dan Lee. I already fixed a couple of things in the source

tree, makefiles and documentation. I will probably contact Dan Lee per e-mail.

Regards,

Ernst

> an email to pyt...@googlegroups.com
> <mailto:pyt...@googlegroups.com>.

[Ernst Lobsiger]

Dear All,

After a delay of one month I got a first reaction of EUMETSAT/OPS I share below.

There has been no change in the EUMETSAT xRITDecompress gitlab repo so far.

I have solved my problem with a Cygwin64 compiled version of xRITDecompress.

I will now directly contact Dan Lee within the next few days to see how to proceed.

Best regards

Ernst

================================================================

Dear Ernst Lobsiger,

First apologies for the delay in getting back to you regarding this ticket.
We wanted to inform you that the Product Navigator have been updated as requested:
https://navigator.eumetsat.int/product/EO:EUM:SW:MSG:153?query=public&s=simple

Regarding 2b, we are looking into an implementation of your request,  we will let you know of any updates on this matter.

Best regards,

Maria

EUMETSAT User Service

EUMETSAT
Eumetsat-Allee 1
64295 Darmstadt
Germany

================================================================

Am Dienstag, 28. April 2020 16:38:18 UTC+2 schrieb Ernst Lobsiger: