Apache Spark Review

Stable, fast, and easy to use


What is our primary use case?

We primarily use the solution to integrate very large data sets from another environment, such as our SQL environment, and draw purposeful data before checking it. We also use the solution for streaming very very large servers. 

What is most valuable?

It is a very fast solution. It's very easy to use. There are many RPis with many languages like Scala, Java, R, and Python. The greatest advantage of Spark is that we can initiate many kinds of analytics including SQL analytics, graphics analytics, etc. 

What needs improvement?

The solution needs to optimize shuffling between workers.

For how long have I used the solution?

I've been using the solution for four or five years.

What do I think about the stability of the solution?

The solution is very stable.

What do I think about the scalability of the solution?

The solution is scalable. My understanding is version 3.0 has renewed scaling capabilities and will be able to do so automatically.

How are customer service and technical support?

Apache is an open-source platform so there is no technical support.

What other advice do I have?

We use both on-premises and public and private cloud deployment models. We're partners with Databricks.

I'm a consultant. Our company works for large enterprises such as banks and energy companies. 17 of our workers use Apache Spark.

With the cloud, there are many companies that integrate Spark. Most projects in big data around the world use Spark, indirectly or directly. 

I'd rate the solution eight out of ten.

Which version of this solution are you currently using?

2.4
**Disclosure: I am a real user, and this review is based on my own experience and opinions.
More Apache Spark reviews from users
...who work at a Financial Services Firm
...who compared it with Amazon EMR
Learn what your peers think about Apache Spark. Get advice and tips from experienced pros sharing their opinions. Updated: January 2021.
457,209 professionals have used our research since 2012.
Add a Comment
Guest