Pegasus (workflow management)

Pegasus is an open-source workflow management system.^[1][2][3] It provides the necessary abstractions for scientists to create scientific workflows^[4] and allows for transparent execution of these workflows on a range of computing platforms including high performance computing clusters, clouds, and national cyberinfrastructure.^[5][6] In Pegasus, workflows are described abstractly as directed acyclic graphs (DAGs) using a provided API for Jupyter Notebooks, Python, R, or Java.^[7] During execution, Pegasus translates the constructed abstract workflow into an executable workflow^[8][9] which is executed and managed by HTCondor.^[10][11]

Pegasus

Developer(s)	University of Southern California, Information Sciences Institute, University of Wisconsin-Madison
Stable release	5.0 Beta1 / July 27, 2020; 4 years ago (2020-07-27)
Written in	Java, Python, C
Operating system	macOS, Linux
Type	Workflow management system
License	Apache License 2.0
Website	pegasus.isi.edu

Pegasus is being used in a number of different disciplines including astronomy, gravitational-wave physics, bioinformatics, earthquake engineering, and helioseismology.^[12] Notably, the LIGO Scientific Collaboration has used it to directly detect a gravitational wave for the first time.^[8][13][14]

Area of applications

Application examples:^[5][6]

• Gravitational-Wave Physics
• Earthquake Science
• Bioinformatics
• Workflows for Volcanic Mass Flows
• Diffusion Image Processing and Analysis
• Spallation Neutron Source (SNS)

History

The development of Pegasus started in 2001.

See also

• Distributed computing
• Workflow Management System