Apache Spark Pros and Cons

I found the solution stable. We haven't had any problems with it.

The most valuable feature of this solution is its capacity for processing large amounts of data.

The scalability has been the most valuable aspect of the solution.

With Hadoop-related technologies, we can distribute the workload with multiple commodity hardware.

Features include machine learning, real time streaming, and data processing.

The fault tolerant feature is provided.

It provides a scalable machine learning library.

It needs a new interface and a better way to get some data. In terms of writing our scripts, some processes could be faster.

When you first start using this solution, it is common to run into memory errors when you are dealing with large amounts of data.

The management tools could use improvement. Some of the debugging tools need some work as well. They need to be more descriptive.

Include more machine learning algorithms and the ability to handle streaming of data versus micro batch processing.

It should support more programming languages.

Needs to provide an internal schedule to schedule spark jobs with monitoring capability.