Spark SQL Other Advice
Overall, I would rate Spark SQL as a seven out of ten.
View full review »It's pretty good to use in the initial phases. Overall, I would rate the solution an eight out of ten.
View full review »Training is quite important to get users up to scratch with Sparks SQL and Spark. Planning is needed in terms of training and skillsets. In terms of the typical DevOps MLOps deployment with pipelines, this training is particularly important. Otherwise you may end up with lots of functionality and queries that are difficult to change, deploy or maintain.
I would rate this solution an eight out of ten. In terms of scalability, it is very useful.
View full review »Buyer's Guide
Spark SQL
March 2024
Learn what your peers think about Spark SQL. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
767,995 professionals have used our research since 2012.
If the user data has a big volume of data, I think they should use PySpark, but for scenarios where they use a medium amount of data, they should not use PySpark because they have some overheads. I rate Spark SQL a nine out of ten.
View full review »SB
Slaven Batnozic
CTO at Dokument IT d.o.o.
I recommend Spark SQL, but I will need to see what the results will be of our evaluation of Dremio. I'm especially expecting good performance because of the reflection mechanisms, which are actually materials used. But the open question is issues with the refresh rate. I don't know how bad or good that is.
I rate Spark SQL a ten out of ten with the correct implementation.
View full review »I recommend this solution. Spark provides good, clear documentation that is well organized.
KM
Keshav Mandal
Senior Analyst/ Customer Business and Insights Specialist at a tech services company with 501-1,000 employees
The solution is very similar to the generic Spark and SQL language.
I rate the solution an eight out of ten.
View full review »SS
Srinivasan Sugumar
Analytics and Reporting Manager at a financial services firm with 1,001-5,000 employees
We will have a lot of big data, which is why we need it. Otherwise, the solution is not needed. The solution really depends on the size of your data, its complexity, and the analysis that you are doing. Spark is good, but it is not mandatory.
Since I don't have experience in production with the solution, the best I can rate it now is a five (out of 10).
View full review »DM
DulalMali
Data Analytics Practice head at bse
We use both the on-premises and cloud deployment models.
We have a relationship with Cloudera and use their distribution channels. We don't have a relationship with Apache.
Spark SQL is a good product. However, users need to have the capability of implementing the correct tools and efficiencies.
I'd rate the solution seven out of ten.
View full review »PK
Piotr Kalanski
Cloud Team Leader at TCL
I would rate Spark SQL a nine out of ten.
My advice would be to read Databricks books about Spark. It's a good source of knowledge.
In the next update, we'd like to see better performance for small points of data. It is possible but there are better tools that are faster and cheaper.
View full review »AG
reviewer1724670
Engineering Manager/Solution architect at a computer software company with 201-500 employees
I rate this solution an eight out of ten and would recommend it to others.
View full review »KG
reviewer1488372
Associate Manager at a consultancy with 501-1,000 employees
I rate Spark SQL a ten out of ten.
View full review »QG
reviewer1427205
Corporate Sales at a financial services firm with 10,001+ employees
Being a new user, I would rate Spark SQL a four out of ten.
View full review »We've just started using this solution. We were using it until recently on a research basis, just to measure the performance, the cost, and so on and so forth. Many things could be improved, but are okay up till now, I'm happy with. I would recommend the product.
I would rate this solution eight out of ten.
View full review »Buyer's Guide
Spark SQL
March 2024
Learn what your peers think about Spark SQL. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
767,995 professionals have used our research since 2012.