Compare Apache Spark vs. Google Cloud Dataflow

Apache Spark is ranked 1st in Hadoop with 9 reviews while Google Cloud Dataflow is ranked 4th in Streaming Analytics. Apache Spark is rated 8.0, while Google Cloud Dataflow is rated 0. The top reviewer of Apache Spark writes "Fast performance and has an easy initial setup". On the other hand, Apache Spark is most compared with Spring Boot, AWS Lambda and Azure Stream Analytics, whereas Google Cloud Dataflow is most compared with Apache NiFi, Apache Spark and Amazon Kinesis.
Cancel
You must select at least 2 products to compare!
Apache Spark Logo
11,326 views|9,310 comparisons
Google Cloud Dataflow Logo
2,361 views|2,079 comparisons
Most Helpful Review
Use Google Cloud Dataflow? Share your opinion.
Find out what your peers are saying about Apache, Cloudera, Hortonworks and others in Hadoop. Updated: August 2019.
365,533 professionals have used our research since 2012.
Quotes From Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

report
Use our free recommendation engine to learn which Hadoop solutions are best for your needs.
365,533 professionals have used our research since 2012.
Ranking
1st
out of 24 in Hadoop
Views
11,326
Comparisons
9,310
Reviews
9
Average Words per Review
184
Avg. Rating
8.0
4th
out of 24 in Streaming Analytics
Views
2,361
Comparisons
2,079
Reviews
0
Average Words per Review
0
Avg. Rating
N/A
Top Comparisons
Compared 29% of the time.
Compared 12% of the time.
Compared 29% of the time.
Also Known As
Google Dataflow
Learn
Apache
Google
Overview

Spark provides programmers with an application programming interface centered on a data structure called the resilient distributed dataset (RDD), a read-only multiset of data items distributed over a cluster of machines, that is maintained in a fault-tolerant way. It was developed in response to limitations in the MapReduce cluster computing paradigm, which forces a particular linear dataflowstructure on distributed programs: MapReduce programs read input data from disk, map a function across the data, reduce the results of the map, and store reduction results on disk. Spark's RDDs function as a working set for distributed programs that offers a (deliberately) restricted form of distributed shared memory

Google Dataflow is a unified programming model and a managed service for developing and executing a wide range of data processing patterns including ETL, batch computation, and continuous computation. Cloud Dataflow frees you from operational tasks like resource management and performance optimization.
Offer
Learn more about Apache Spark
Learn more about Google Cloud Dataflow
Sample Customers
NASA JPL, UC Berkeley AMPLab, Amazon, eBay, Yahoo!, UC Santa Cruz, TripAdvisor, Taboola, Agile Lab, Art.com, Baidu, Alibaba Taobao, EURECOM, Hitachi SolutionsAbsolutdata, Backflip Studios, Bluecore, Claritics, Crystalloids, Energyworx, GenieConnect, Leanplum, Nomanini, Redbus, Streak, TabTale
Top Industries
REVIEWERS
Financial Services Firm29%
Software R&D Company29%
Healthcare Company14%
Non Profit14%
VISITORS READING REVIEWS
Software R&D Company20%
Comms Service Provider14%
Financial Services Firm12%
Media Company8%
No Data Available
Find out what your peers are saying about Apache, Cloudera, Hortonworks and others in Hadoop. Updated: August 2019.
365,533 professionals have used our research since 2012.
We monitor all Hadoop reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
Sign Up with Email