WfInstances

318 open workflow execution instances

Workflow instances are widely used to profile and characterize workflow executions, and to build distributions of workflow execution behaviors, which are used to evaluate methods and techniques in simulation or in real conditions.

WfInstances collects and curates open access production workflow executions from various scientific applications, shared in the common WfFormat instance format. The WfCommons Python package provides tools for analyzing instances, which can be used to develop workflow recipes for WfGen.

WfInstances Browser

Search, visualize, and simulate all 318 instances online

No cloning or setup required — the browser indexes every instance from the 6 repositories below, so you can find the right workflow before you download it.

  • Filter & sortBy tasks, files, data size, and runtime
  • Visualize DAGsInspect task graphs and export them as SVG
  • SimulateRun schedulers on a platform you define
  • DownloadGrab selected instances in WfFormat
Open the WfInstances Browser →
The WfInstances Browser: a searchable table of workflow instances with task counts, file counts, data sizes, and runtimes
Repositories

Open access instance repositories

Instances are organized by workflow system. Each sub-folder is a workflow application containing executions on different computing platforms, with a README.md that describes the workflow structure and points to relevant material.

WfInstances on GitHub →

Pegasus Execution Instances

135instances
7applications
View on GitHub →

Nextflow Execution Instances

116instances
17applications
View on GitHub →

Snakemake Execution Instances

34instances
3applications
View on GitHub →

Makeflow Execution Instances

30instances
2applications
View on GitHub →

Hello World Execution Instances

2instances
1applications
View on GitHub →

StreamFlow Execution Instances

1instances
1applications
View on GitHub →

We are always looking for additional workflow execution instances to refine existing recipes or develop new ones. Have instances to share? Contact support@wfcommons.org.