2019-07-16T05:40:00Z

What advice do you have for others considering Spark SQL?


If you were talking to someone whose organization is considering Spark SQL, what would you say?

How would you rate it and why? Any other tips or advice?

Guest
44 Answers

author avatar
Top 5LeaderboardReal User

I would rate Spark SQL a nine out of ten. My advice would be to read Databricks books about Spark. It's a good source of knowledge. In the next update, we'd like to see better performance for small points of data. It is possible but there are better tools that are faster and cheaper.

2020-04-26T06:32:00Z
author avatar
Top 10Real User

We will have a lot of big data, which is why we need it. Otherwise, the solution is not needed. The solution really depends on the size of your data, its complexity, and the analysis that you are doing. Spark is good, but it is not mandatory. Since I don't have experience in production with the solution, the best I can rate it now is a five (out of 10).

2020-03-18T06:06:00Z
author avatar
Top 5LeaderboardReal User

We use both the on-premises and cloud deployment models. We have a relationship with Cloudera and use their distribution channels. We don't have a relationship with Apache. Spark SQL is a good product. However, users need to have the capability of implementing the correct tools and efficiencies. I'd rate the solution seven out of ten.

2020-02-09T08:17:05Z
author avatar
Real User

We've just started using this solution. We were using it until recently on a research basis, just to measure the performance, the cost, and so on and so forth. Many things could be improved, but are okay up till now, I'm happy with. I would recommend the product. I would rate this solution eight out of ten.

2019-07-16T05:40:00Z
Find out what your peers are saying about Apache, Informatica, VMware and others in Hadoop. Updated: September 2020.
442,845 professionals have used our research since 2012.