Apache Airflow Reviews

Alexey Nadenenko

Solution Architect at EPAM Systems

Sep 04 2019

Simple to automate using Python, but code does not cover all data warehousing tasks

What is most valuable?

The most valuable feature is the UI, for automation.One can monitor all ETL processes in single screen. Complex workflows are shown as DAGs SVG images. This is a simple tool to automate using Python.

What needs improvement?

There are some drawbacks to this solution. The code does not cover all tasks in the data warehouse automation process. Currently , in production, we have a large installation with a complex workflow… more»

What's my experience with pricing, setup cost, and licensing?

There are no costs associated with this solution. Apache Airflow is a free solution that can be downloaded and ready for use at any moment.

If you previously used a different solution, which one did you use and why did you switch?

Previously, we used Control-M for a short period. It was a solution used by our customers, and we needed to understand their difficulties and the results. For low to middle scaled tasks, Apache… more»

What other advice do I have?

My advice would be to use this solution for simple tasks. They should have a Python expert for features that are not available out of the box, as it is not enough. It could be a good solution for… more»

Which other solutions did I evaluate?

Our tasks can be automated by simple Jenkins, but our customer wanted to implement it on Apache Airflow. This was a solution used by our customer. Apache Airflow is mainstream and everyone wants to… more»

See Entire Apache Airflow Review (825 Words) »

Articles

User Assessments By Topic About Apache Airflow

Apache Airflow Questions

What is Apache Airflow?

Airflow is a platform to programmatically author, schedule and monitor workflows.

Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command line utilities make performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress, and troubleshoot issues when needed.

When workflows are defined as code, they become more maintainable, versionable, testable, and collaborative.

Also known as

Airflow

Apache Airflow customers

Agari, WePay, Astronomer