LiberTEM 0.9.0 released

[Dieter Weber]

Dear subscribers,

we are most happy to announce the release of LiberTEM 0.9.0 with full
Dask array integration!

Most notably, HyperSpy lazy signals and LiberTEM can now be combined
seamlessly. Many thanks to Matthew Bryan who implemented major parts of
this non-trivial feature.

This enables the following applications:

* Use HyperSpy file readers and other readers that create Dask arrays
for LiberTEM.
* Create an ad-hoc file reader for LiberTEM by just building a Dask
array from your input data.
* Use LiberTEM file readers for HyperSpy and other software that works
with Dask arrays.
* Use the same implementation of an algorithm for live processing with
LiberTEM, offline processing with LiberTEM, and offline processing with
HyperSpy.
* Simplify implementation of complex processing routines on Dask arrays.
* Chain processing steps together using Dask arrays for intermediate
results.

More details about Dask integration can be found at
https://libertem.github.io/LiberTEM/dask.html.

Please note that these features are still experimental and cover a large
space of possible uses and parameters. Expect the unexpected! Tests,
feedback and improvements are highly appreciated.

Other improvements
------------------

* Support for TVIPS binary files
* Support for MIB Quad integer and some raw formats
* Parameter guessing for center of mass analysis
* I/O back-end selection and direct I/O, beneficial for very large data
on fast SSDs
* Docker image available: https://hub.docker.com/r/libertem/libertem/tags
* Improved parameter handling and the new threaded
`ConcurrentJobExecutor` speed up UDFs with large parameters, for example
single side band ptychography.
* Various other performance and quality improvements

The full release notes with details on the changes and new features can
be found at https://libertem.github.io/LiberTEM/changelog.html#latest

Future plans
------------

* Explore new application opportunities that Dask array integration opens.

* Continue to improve web integration, in particular opening datasets
through command line or URL parameters.

* Improve live data processing: Performance, scalability and support for
more cameras.

* A plugin interface to make integration of new functionality in the GUI
easier.

* Custom GUIs with Panel: https://panel.holoviz.org/

* Processing sparse data, for example from event-based detectors.

If you are using LiberTEM, and have feedback for us, don't hesitate to
reach out! Please also let us know if you are missing a crucial feature
which currently prevents you from using LiberTEM.

You can reach us online in the Issue tracker
<https://github.com/LiberTEM/LiberTEM/issues>, Gitter chat
<https://gitter.im/LiberTEM/Lobby> or by e-mail: Alexander Clausen
<a.cl...@fz-juelich.de>, Dieter Weber <d.w...@fz-juelich.de>.

With best regards,
Dieter

--
Dr. Dieter WEBER

Peter Grünberg Institute, Microstructure Research (PGI-5)
Ernst Ruska-Centre for Microscopy and Spectroscopy with Electrons (ER-C)
Forschungszentrum Jülich
52425 Jülich, Germany

Email: d.w...@fz-juelich.de
Phone: +49 2461 61 85118


------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Forschungszentrum Juelich GmbH
52425 Juelich
Sitz der Gesellschaft: Juelich
Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498
Vorsitzender des Aufsichtsrats: MinDir Volker Rieke
Geschaeftsfuehrung: Prof. Dr.-Ing. Wolfgang Marquardt (Vorsitzender),
Karsten Beneke (stellv. Vorsitzender), Prof. Dr. Astrid Lambrecht,
Prof. Dr. Frauke Melchior
------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------