See also: https://github.com/pditommaso/awesome-pipeline
- Arvados http://arvados.org
- Taverna http://www.taverna.org.uk/
- Galaxy http://galaxyproject.org/
- SHIWA https://www.shiwa-workflow.eu/
- Oozie https://oozie.apache.org/
- DNANexus https://wiki.dnanexus.com/API-Specification-v1.0.0/IO-and-Run-Specifications# https://wiki.dnanexus.com/API-Specification-v1.0.0/Workflows-and-Analyses#
- BioDT http://www.biodatomics.com/
- Agave http://agaveapi.co/live-docs/
- DiscoveryEnvironment http://www.iplantcollaborative.org/ci/discovery-environment
- Wings http://www.wings-workflows.org/
- Knime https://www.knime.org/
- make, rake, drake, ant, scons & many others. Software development relies heavily on tools to manage workflows related to compiling and packaging applications. For the most part these are file based and usually run on a single node, usually supporting parallel steps (make -j) and in some cases able to dispatch build steps to other machines (https://code.google.com/p/distcc/) https://github.com/Factual/drake
- Snakemake https://bitbucket.org/johanneskoester/snakemake
- BPipe http://bpipe.org
- Ruffus https://code.google.com/p/ruffus/
- NextFlow http://nextflow.io
- Luigi http://github.com/spotify/luigi
- SciLuigi. Helper library built on top of Luigi to ease development of Scientific workflows in Luigi: http://github.com/samuell/sciluigi
- GATK Queue https://www.broadinstitute.org/gatk/guide/topic?name=queue
- Yabi https://ccg.murdoch.edu.au/yabi
- seqware Workflows are written in Java and executed using the Oozie Workflow Engine on Hadoop or SGE clusters. Uses Zip64 files to group the workflow definition file, workflow itself, sample settings, and data dependencies in a single file that can be exchanged between SeqWare users or archived. https://seqware.github.io/ https://seqware.github.io/docs/6-pipeline/
- Ketrew https://github.com/hammerlab/ketrew
- Pegasus http://pegasus.isi.edu/
- Airflow https://github.com/airbnb/airflow
- Cosmos https://cosmos.hms.harvard.edu/documentation/index.html http://bioinformatics.oxfordjournals.org/content/early/2014/07/24/bioinformatics.btu385.full [paper] Cosmos2: https://github.com/LPM-HMS/COSMOS2 http://cosmos.hms.harvard.edu/COSMOS2/
- Pinball https://github.com/pinterest/pinball
- bcbio https://bcbio-nextgen.readthedocs.org/en/latest/
- Chronos https://github.com/mesos/chronos
- Azkaban https://azkaban.github.io/
- Apache NiFi https://nifi.apache.org/docs/nifi-docs/html/overview.html
- flowr (R-based) http://docs.flowr.space/ https://github.com/sahilseth/flowr
- Mistral https://github.com/arteria-project https://wiki.openstack.org/wiki/Mistral#What_is_Mistral.3F https://wiki.openstack.org/wiki/Mistral/DSLv2
- nipype http://nipy.org/nipype/
- End of Day https://github.com/joestubbs/endofday
- BioDSL https://github.com/maasha/BioDSL
- BigDataScript http://pcingola.github.io/BigDataScript/
- Omics Pipe: uses Ruffus http://sulab.scripps.edu/omicspipe/
- Ensembl Hive https://github.com/Ensembl/ensembl-hive
- QuickNGS http://bifacility.uni-koeln.de/quickngs/web
- GenePattern http://www.broadinstitute.org/cancer/software/genepattern/
- Chipster http://chipster.csc.fi/
- The Genome Modeling System https://github.com/genome/gms
- Cuneiform, A Functional Workflow Language https://github.com/joergen7/cuneiform http://www.cuneiform-lang.org/
- Anvaya http://www.ncbi.nlm.nih.gov/pubmed/22809419 http://webapp.cabgrid.res.in/biocomp/Anvaya/ANVAYA_Main.html#HOWTO_INSTALL_ANVAYA
- Makeflow http://ccl.cse.nd.edu/software/makeflow/
- Airavata http://airavata.apache.org/
- Pyflow https://github.com/Illumina/pyflow
- Clusterflow https://github.com/ewels/clusterflow
- Unipro UGENE http://ugene.net/ https://dx.doi.org/10.7717/peerj.644
- CloudSlang http://www.cloudslang.io/
- Stacks http://catchenlab.life.illinois.edu/stacks/
- Leaf http://www.francesconapolitano.it/leaf/index.html
- omictools http://omictools.com/
- Job Description Language. The Job Description Language, JDL, is a high-level, user-oriented language based on Condor classified advertisements for describing jobs and aggregates of jobs such as Direct Acyclic Graphs and Collections. https://edms.cern.ch/ui/file/590869/1/WMS-JDL.pdf
- YAWL yet another workflow language http://dx.doi.org/10.1016/j.is.2004.02.002 http://www.yawlfoundation.org/
- Triquetrum https://projects.eclipse.org/projects/technology.triquetrum https://github.com/eclipse/triquetrum/
- Kronos https://github.com/jtaghiyar/kronos
- qsubsec http://doi.org/10.1093/bioinformatics/btv698 https://github.com/alastair-droop/qsubsec
- YesWorkflow http://yesworkflow.org
- GWF - Grid WorkFlow https://github.com/mailund/gwf http://mailund.github.io/gwf/
- Fireworks. https://pythonhosted.org/FireWorks/
- NGLess https://github.com/luispedro/ngless
- pypipegraph https://github.com/TyberiusPrime/pypipegraph
- Cromwell https://github.com/broadinstitute/cromwell
- Dagobah - Simple DAG-based job scheduler in Python. https://github.com/thieman/dagobah
- sushi https://github.com/uzh/sushi
- Clinical Trial Processor - A program for processing clinical trials data. http://mircwiki.rsna.org/index.php?title=MIRC_CTP
We need to add toil to this list! https://github.com/DataBiosphere/toil