2018-08 Airflow Azkaban Conductor Oozie Step Functions
Owner Apache LinkedIn Netflix Apache Amazon
Community Very Active Somewhat active Active Active N/A
History 4 years 7 years 1.5 years 8 years 1.5 years
Main Purpose General PurposeBatch Process Hadoop Job Scheduling Microservice orchestration Hadoop Job Scheduling General Purpose Workflow Process
Flow Definition Python Custom DSL JSON XML JSON
Support for single node Yes Yes Yes Yes N/A
Quick demo setup Yes Yes Yes No N/A
Support for HA Yes Yes Yes Yes Yes
Single Point of Failure Yes Yes No No No
HA Extra Requirement Celery/Dask/Mesos+Load Balancer+DB DB Load Balancer(web nodes)+DB Load Balancer(web nodes) Native+DB+Zookeeper Native

【参考】

1。https://xunnanxu.github.io/2018/04/13/Workflow-Processing-Engine-Overview-2018-Airflow-vs-Azkaban-vs-Conductor-vs-Oozie-vs-Amazon-Step-Functions/

results matching ""

    No results matching ""