Google Dataflow Competitors and Alternatives

Read reviews of Google Dataflow competitors and alternatives
Anonymous avatar x80
Real User
Senior Automation Test Developer/Automation Test Architect at a software R&D company with 51-200 employees
Jan 15 2018

What is most valuable?

We use AWS Function and Jenkins API to trigger the Jenkins job from the AWS CodePipeline. Since our automated deploy jobs are on AWS, and automated tests are on Jenkins. Then we can create the release pipeline including AWS and Jenkins and... more»

How has it helped my organization?

My automation test story is we moved from CircleCI to Jenkins, then to AWS. The benefit I can see is the maintenance and budget. Ops made this decision but it did not affect automation tests and the release pipeline too much, but I have seen... more»

What needs improvement?

1. Cannot checkout code from GitHub but Jenkins can. 2. No shell script supported. 3. CodePipeline cannot send notification to Slack, but we can use Slack API and Lambda Function.
Anonymous avatar x80
Consultant
Big Data Consultant at a tech services company with 501-1,000 employees
Aug 25 2017

What do you think of Apache Spark?

Valuable Features The good performance. The nice graphical management console. The long list of ML algorithms. • Improvements to My Organization We are able to solve problems, e.g., reporting on big data, that we were not able to tackle in the past. • Room for Improvement Apache Spark provides very good performance The tuning phase is still tricky. • Use of Solution I've used it for 2 years. • Deployment Issues We didn't have an issue with the deployment. • Stability Issues In the past we deployed Spark 1.3 to use Spark SQL but unfortunately one of our queries failed because of a bug fixed in following releases. Then we moved to Spark 1.6 but still some queries were failing when run against huge datasets. Now we are using version 2.1: it is more stable, it...

Sign Up with Email