Apache Airflow Overview

Apache Airflow is the #12 ranked solution in our list of BPM Software. It is most often compared to Camunda BPM: Apache Airflow vs Camunda BPM

What is Apache Airflow?

Airflow is a platform to programmatically author, schedule and monitor workflows.

Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command line utilities make performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress, and troubleshoot issues when needed.

When workflows are defined as code, they become more maintainable, versionable, testable, and collaborative.

Apache Airflow is also known as Airflow.

Apache Airflow Buyer's Guide

Download the Apache Airflow Buyer's Guide including reviews and more. Updated: January 2021

Apache Airflow Customers

Agari, WePay, Astronomer

Apache Airflow Video

Pricing Advice

What users are saying about Apache Airflow pricing:
  • "Apache Airflow is a free solution that can be downloaded and ready for use at any moment."

Apache Airflow Reviews

Filter by:
Filter Reviews
Industry
Loading...
Filter Unavailable
Company Size
Loading...
Filter Unavailable
Job Level
Loading...
Filter Unavailable
Rating
Loading...
Filter Unavailable
Considered
Loading...
Filter Unavailable
Order by:
Loading...
  • Date
  • Highest Rating
  • Lowest Rating
  • Review Length
Search:
Showingreviews based on the current filters. Reset all filters
Sudhir Ganti
Engineering Manager - OTT Platform at Amagi
Real User
Top 5
Apr 26, 2020
Download
Helps us maintain a clear separation of our functional logic from our operational logic

What is our primary use case?

We are a technology, media, and entertainment-technology company. We are using Apache Airflow for architecting our media workflows. We are using it for two major workflows. We have had it set up for some time on our own cloud. Recently, we migrated the setup to AWS.

Pros and Cons

  • "The reason we went with Airflow is its DAG presentation, that shows the relationships among everything. It's more of a configuration-driven workflow."
  • "One specific feature that is missing from Airflow is that the steps of your workflow are not pipelined, meaning the stageless steps of any workflow. Not every workflow can be implemented within Airflow."

What other advice do I have?

We have a team of people, four to five team members, who initially evaluated Airflow and wanted to implement it. We have customers onboarded on our legacy systems. I cannot disrupt the service and bring everything into Airflow. I have to onboard Airflow seamlessly, while I protect my current, ongoing business systems. So I'm trying to balance things here. We have only been able to onboard a couple of workflows. Eventually, we want to do it more fully, but there were a few challenges as I told you: There is no pipeline to take information, which is forcing me to retain my state in a separate…
See Entire Apache Airflow Review (1075 Words) »
reviewer1447245
Senior Solutions Architect/ Software Architect at a comms service provider with 51-200 employees
Real User
Top 5Leaderboard
Dec 23, 2020
Download
Integrates well with other pipelines and builds different processes well but the scalability needs improvement

What is our primary use case?

We normally use the solution for creating a specific flow for data transformation. We have several pipelines that we use and due to the fact that they're pretty well-defined, we use it in conjunction with other tools that do the mediation portion. With Airflow, we do the processing of such data.

Pros and Cons

  • "The product integrates well with other pipelines and solutions."
  • "The scalability of the solution itself is not as we expected. Being on the cloud, it should be easy to scale, however, it's not."

What other advice do I have?

We're just customers and end-users. We don't have a special business relationship with Apache. I'm not sure of which version of the solution we're using. It's likely the most up-to-date, or at the very most back two or three versions as we are not using any of the older versions. I'd advise others considering the solution to first understand what exactly you're trying to achieve. You either select a non-cloud native Apache workflow manager or select something that is way too big for what you are actually trying to achieve. Understand what is exactly what you need and the volumes that you need…
See Entire Apache Airflow Review (1073 Words) »
Free Report: Apache Airflow Reviews and More
Learn what your peers think about Apache Airflow. Get advice and tips from experienced pros sharing their opinions. Updated: January 2021.
Download now
455,164 professionals have used our research since 2012.
Alexey Nadenenko
Solution Architect at EPAM Systems
Vendor
Sep 4, 2019
Download
Simple to automate using Python, but code does not cover all data warehousing tasks

What is our primary use case?

The primary use case for this solution is to automate ETL process for datawarehouse.

Pros and Cons

  • "This is a simple tool to automate using Python."
  • "We need to develop our workflow description and notations because out of the box, Apache Airflow does not provide some features that are needed."

What other advice do I have?

My advice would be to use this solution for simple tasks. They should have a Python expert for features that are not available out of the box, as it is not enough. It could be a good solution for enterprise workflow automation and solutions like Control-M within the next two to three years. We are happy and satisfied with this solution, but not fully satisfied, as this solution has some positive and negative aspects. I would rate this solution a seven out of ten.
See Entire Apache Airflow Review (819 Words) »
Ashok Juyal
Associate Director - Technologies at a tech services company with 51-200 employees
Real User
Dec 27, 2020
Download
Quick and easy to set up, but the technical support needs to be improved

What is our primary use case?

Our primary use case is to integrate with SLAs.

What is most valuable?

The most valuable feature is the workflow.

What needs improvement?

Technical support is an area that needs improvement. The contact numbers should be readily available so that we can call to get support as required. In the future, I would like to see a single-click installation.

For how long have I used the solution?

We have been working with Apache Airflow for approximately one month.

What do I think about the scalability of the solution?

In our company, we are doing a POC and there are only three users. We have also implemented it for clients. We do plan to increase our usage and the POC that we are now working on is something that we will implement for other clients…
See Entire Apache Airflow Review (285 Words) »
Product Categories
Business Process Management
Buyer's Guide
Download our free Apache Airflow Report and get advice and tips from experienced pros sharing their opinions.
Download Now
Quick Links
Learn More: Questions: