LiberTEM 0.11.0 and LiberTEM-live 0.2.0 released
Weber, Dieter
Dear subscribers,
We are happy to announce the release of LiberTEM 0.11.0 and LiberTEM-live 0.2.0, at last!
This release introduces first-class support for sparse input data and processing using sparse-compatible libraries, primarily oriented towards data from event-based detectors. Only non-zero values are stored and processed when using sparse arrays, which can shrink file size and improve processing performance dramatically. See Sparse arrays for details on how to use it in your UDFs, and Raw binary files in sparse CSR format for a sparse input file format!
The performance of LiberTEM-live was massively improved through parallel processing, improved data transfer and optimized code. It now includes support for DECTRIS EIGER2-based detectors like the QUADRO or ARINA, and experimental support for the event-based ASI CheeTah T3 (Timepix3-based). Please note that a suitable version of the CheeTah T3 software is required.
The LiberTEM-live release 0.2.0 changes the API for creating acquisition objects. Older scripts for version 0.1.0 will have to be updated.
These releases also mark the end of official support for Python 3.6. At this time the maximum supported Python version remains 3.10.
Many thanks to all the people who contributed to this release, through code, testing, feedback and inspiration! The updated acknowledgements can now be found centrally at https://libertem.github.io/.
Other highlighted improvements
- Support for C-ordered 4D DM4 files. Support for the older transposed file layout is still work in progress.
- Support for nav shape and scan offset adjustments in HDF5.
- Data recording in LiberTEM-live through RecordUDF
- Support for 2x2 layouts of Merlin Medipix for live processing.
See the change logs https://libertem.github.io/LiberTEM/changelog.html#v0-11-0 and https://libertem.github.io/LiberTEM-live/changelog.html#v0-2-0 for more details!
Ongoing activities and future plans
- Release on conda-forge is still in preparation and will be announced separately.
- Ongoing efforts to support more cameras with live processing.
- Performance optimization for sparse data and GPU processing.
You can reach us online in the Issue tracker <https://github.com/LiberTEM/LiberTEM/issues>, Gitter chat <https://gitter.im/LiberTEM/Lobby> or by e-mail: Alexander Clausen <a.cl...@fz-juelich.de>, Dieter Weber <d.w...@fz-juelich.de>, Matthew Bryan <matthe...@cea.fr>.
With best regards,
Dieter
--
Dr. Dieter WEBER
Peter Grünberg Institute, Microstructure Research (PGI-5) Ernst Ruska-Centre for Microscopy and Spectroscopy with Electrons (ER-C) Forschungszentrum Jülich
52425 Jülich, Germany
Email: d.w...@fz-juelich.de
Phone: +49 2461 61 85118
------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Forschungszentrum Juelich GmbH
52425 Juelich
Sitz der Gesellschaft: Juelich
Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498
Vorsitzender des Aufsichtsrats: MinDir Stefan Müller
Geschaeftsfuehrung: Prof. Dr.-Ing. Wolfgang Marquardt (Vorsitzender),
Karsten Beneke (stellv. Vorsitzender), Dr. Ir. Pieter Jansens,
Prof. Dr. Astrid Lambrecht, Prof. Dr. Frauke Melchior
------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------