Spark SQL Reviews

Seniorsoen67

Project Manager - Senior Software Engineer at a tech services company with 11-50 employees

Jul 17 2019

A good stable and scalable solution for processing big data

What do you think of Spark SQL?

What is our primary use case?

The primary use is to process big data. We were connecting into and we were applying sentiment analysis via hardware.

What needs improvement?

In the next release, maybe the visualization of some command-line features could be added.

For how long have I used the solution?

I've been using the solution for two to three weeks.

What do I think about the stability of the solution?

The stability was fine. It behaved as expected.

What do I think about the scalability of the solution?

The scalability of the solution is good.

How are customer service and technical support?

Technical support has been fine.

If you previously used a different solution, which one did you use and why did you switch?

We previously used Apache Hadoop.

How was the

…

See Entire Spark SQL Review (226 Words) »

Articles

User Assessments By Topic About Spark SQL

Spark SQL Questions

What is Spark SQL?

Spark SQL is a Spark module for structured data processing. Unlike the basic Spark RDD API, the interfaces provided by Spark SQL provide Spark with more information about the structure of both the data and the computation being performed. There are several ways to interact with Spark SQL including SQL and the Dataset API. When computing a result the same execution engine is used, independent of which API/language you are using to express the computation. This unification means that developers can easily switch back and forth between different APIs based on which provides the most natural way to express a given transformation.