Asterism: Pegasus and dispel4py hybrid workflows for data-intensive science

Publication Title: Asterism: Pegasus and dispel4py hybrid workflows for data-intensive science

Authors: Rosa Filgueira, Rafael Ferreira da Silva, Amrey Krause, Ewa Deelman, Malcolm Atkinson

 

Pegasus WMS: https://pegasus.isi.edu

dispel4py: http://dispel4py.org

 

Containers

Container 1: Pegasus + dispel4py + HTCondor – https://github.com/dispel4py/pegasus_dispel4py

Container 2: MPI cluster – https://github.com/dispel4py/pegasus_dispel4py/tree/master/Docker

Container 3: Apache Storm cluster – https://github.com/dispel4py/storm-docker

 

DockerHub image: https://hub.docker.com/r/dispel4py/pegasus

 

Script for the deployment of the Docker Containers: https://github.com/dispel4py/pegasus_dispel4py/blob/master/commands_to_deploy_enviroment.sh