We consider the problem of orchestrating the execution of workflow applications structured as Directed Acyclic Graphs (DAGs) on parallel computing platforms that are subject to fail-stop failures. The objective is to minimize expected overall execution time, or makespan. A solution … Read More
The ATLAS experiment at CERN uses PanDA (Production and Data Analysis) Workload Management System for managing the workflow for all data processing on over 150 data centers. Through PanDA, ATLAS physicists see a single computing facility that enables rapid scientific … Read More
A common characteristic to major physics experiments is an ever increasing need of computing resources to process experimental data and generate simulated data. The IN2P3 Computing Center (CC-IN2P3) provides its 2,500 users with about 35,000 cores and processes millions of … Read More
Since October 2016, Rosa Filgueira has been working at the British Geological Survey (BGS) as a Senior Data Scientist. She is involved in a variety of national and international research projects where she applies different technologies from Data Science and … Read More
In March of 2013 I visited ISI and presented on what was then the fledging Center for Trustworthy Scientific Cyberinfrastructure (CTSC), an effort to provide the NSF community with cybersecurity expertise and leadership. It’s been nearly five years since and … Read More
Clear trends in the past and current petascale systems (i.e., Jaguar and Titan) and the new generation of systems that will transition us toward exascale (i.e., Aurora and Summit) outline how concurrency and peak performance are growing dramatically, however, I/O … Read More
AWS Batch is a fully-managed service that enables developers, scientists, and engineers to easily and efficiently run batch computing workloads of any scale on AWS. The service automatically provisions compute resources and optimizes the workload distribution based on the quantity … Read More
Astrophysics is transforming from a data-starved to a data-swamped discipline, fundamentally changing the nature of scientific inquiry and discovery. New technologies are enabling the detection, transmission, and storage of data of hitherto unimaginable quantity and quality across the electromagnetic, gravity … Read More
Simulation is a fast, controlled, and reproducible way to evaluate new algorithms for distributed computing platforms in a variety of conditions. However, the realism of simulations is rarely assessed, which critically questions the applicability of a whole range of findings. … Read More
The talk gives first an overview of the research conducted at the Institute of Computer Science, University of Innsbruck in the area of parallel and distributed systems. Afterwards, it focuses scientific workflows (our common topic of interest) by presenting research … Read More