Open-source · Community-driven

Build, test, and compare workflow systems on realistic data

WfCommons is an open-source ecosystem of workflow execution instances, synthetic workflow generators, and benchmark specifications — powering research on scheduling, performance, resilience, and AI-driven workflow automation across HPC and distributed platforms.

Get started Documentation Explore the ecosystem →
$ pip install wfcommons
PyPI version Downloads License: LGPL v3
298+ Curated workflow execution instances in WfFormat
31+ Scientific applications across workflow systems
83 Research articles enabled by WfCommons
6 Interoperable tools — from schema to simulation

WfFormat

The WfCommons JSON Format

WfCommons uses a common format for representing workflow execution instances and generated synthetic workflows instances, so that workflow simulators and simulation frameworks (that provide support for WfFormat) can use such instances interchangeably.

This common format uses a JSON specification available in the WfFormat GitHub repository. The schema GitHub repository provides detailed explanation of WfFormat (including required fields), and a validator script for verifying the compatibility of instances.

Below, is a visualization of the schema version 1.3: