Why Scientific Workflows?

Scientific workflows are a flexible representation to declaratively express applications with data and control dependencies, and are mainstream in domains such as astronomy, physics, climate science, earthquake science, biology, and others. Learn more.

 

Our Vision

The SciTech research group aims to empower the scientific community by tightening the relations between the domain scientists and current computational resources. As a result, scientists can focus on their research questions, while our open-source tools provide the computational foundations to seamlessly run their experiments and analyses in local and distributed resources.

Automation

We provide tools to automate and advance scientific analyses from the scientist's desktop to clouds and world-class supercomputers. Learn more.

Reproducibility

We enable computational reproducible research via data provenance, and data and software preservation mechanisms. Learn more.

Big Data

Our tools automatically manage large volumes of data transfers between different computational resources and data repositories. Learn more.

Data Science

We provide tools to collect fine-grained performance data from experiments and the computational environment. Learn more.

Latest News

Pegasus receives continued support from the National Science Foundation
with No Comments

The Pegasus team is pleased to announce that it has received a new grant from the National Science Foundation to support new development and maintenance of the Pegasus Workflow Management System.   It will support Pegasus for the next 5 years … Read More

Seminar: Who is afraid of I/O? – Exploring I/O Challenges and Opportunities at the Exascale
with No Comments

Clear trends in the past and current petascale systems (i.e., Jaguar and Titan) and the new generation of systems that will transition us toward exascale (i.e., Aurora and Summit) outline how concurrency and peak performance are growing dramatically, however, I/O … Read More

DoE Panorama project was awarded Best Demo Second Runner-up at GENI Engineering Conference 25
with No Comments

Early this month, Anirban Mandal and Paul Ruth (members of the DoE Panorama project at RENCI) presented a Panorama-based demo at the GENI Engineering Conference 25, and finished in the third place.   Data Flow Prioritization for Scientific Workflows Using … Read More

Seminar: Introducing AWS Batch: A Highly-efficient, Dynamically Scaled Batch Computing Service
with No Comments

AWS Batch is a fully-managed service that enables developers, scientists, and engineers to easily and efficiently run batch computing workloads of any scale on AWS. The service automatically provisions compute resources and optimizes the workload distribution based on the quantity … Read More

Seminar: The Palomar Transient Factory
with No Comments

Astrophysics is transforming from a data-starved to a data-swamped discipline, fundamentally changing the nature of scientific inquiry and discovery. New technologies are enabling the detection, transmission, and storage of data of hitherto unimaginable quantity and quality across the electromagnetic, gravity … Read More

Ewa Deelman receives ISI’s Institute Achievement Award
with No Comments

Dr. Ewa Deelman was honored with a 2015 Institute Achievement Award for technical contributions and leadership in the field of scientific workflow systems for high-performance computing. An innovator in the area of scientific workflow management, Ewa introduced the concept of … Read More

Science Article on Reproducibility
with No Comments

Dr. Ewa Deelman, Dr. Yolanda Gil and six colleagues from other institutions have published an article in Science magazine’s policy forum. Called “Enhancing reproducibility for computational methods,” the piece argues that “access to the computational steps taken to process data … Read More

Seminar: Modeling Distributed Platforms from Application Traces for Realistic File Transfer Simulation
with No Comments

Simulation is a fast, controlled, and reproducible way to evaluate new algorithms for distributed computing platforms in a variety of conditions. However, the realism of simulations is rarely assessed, which critically questions the applicability of a whole range of findings. … Read More