Pegasus 5.1.1 Released

[Karan Vahi]

Hi,

We are happy to announce the release of Pegasus 5.1.1. It is a minor release on top of Pegasus 5.1.0 which is a major release of Pegasus. It also includes all features and bug fixes from the 5.0 branch. We invite our users to give it a try.

We recommend that users upgrade to 5.1.1 and not 5.1.0 because 5.1.1 has a fix for #2113 .

We invite our users to give it a try.

The release can be downloaded from: https://pegasus.isi.edu/downloads

If you are an existing user, please carefully follow these instructions to upgrade at https://pegasus.isi.edu/docs/5.1.1/user-guide/migration.html#migrating-from-pegasus-5-0-x-to-pegasus-5-1

 

Highlights of the Release

1. Refined Data Transfer Mechanisms for Containerized JobsPegasusLite now offers two distinct approaches for handling data transfers in
   containerized jobs. The shift to host-based transfers as the default aims to simplify workflows and minimize the overhead associated with customizing container images.
   • Host-Based Transfers (Default in 5.1.0): Input and output data are staged on the host operating system before launching the container. This method utilizes pre-installed data transfer tools on the host, reducing the need for additional configurations within the container.
   • Container-Based Transfers: Data transfers occur within the container prior to executing user code. This approach requires the container image to include necessary data transfer utilities like curl, ftp, or globus-online. Users preferring this method can set the property pegasus.transfer.container.onhost to false in their configuration files.

   More details can be found in the documentation.

2. Integration with HTCondor’s Container UniversePegasus 5.1.0 introduces support for HTCondor’s container universe, which is useful in pure HTCondor environments such as PATh/OSPool whereby the container management is handled by HTCondor. This integration simplifies job submission and execution, for environments where HTCondor’s container universe is available.This enhancement builds upon Pegasus’s initial container support introduced in version 4.8.0, reflecting ongoing efforts to improve compatibility and user experience.More details can be found in the documentation.
3. pegasus-status command line tool was rewritten in python, removing Pegasus perl dependency. The new pegasus-status command has better support for showing status of hierarchical workflows.
4. Improved determination on what site a job runs on. Starting Pegasus 5.1.0 release, PegasusLite wrapped jobs send a location record that enables us to figure out what resource a job runs on. The location record can be found toward the end of the job .out file as a pegasus multipart record.More details can be found in the documentation.

Exhaustive list of features, improvements and bug fixes can be found in the online release notes

https://pegasus.isi.edu/2025/05/29/pegasus-5-1-1-released/

-Pegasus Team.