Spark SQL Other Advice

SurjitChoudhury - PeerSpot reviewer
Data engineer at Cocos pt

Overall, I would rate Spark SQL as a seven out of ten.

View full review »
Sahil Taneja - PeerSpot reviewer
Principal Consultant/Manager at Tenzing

It's pretty good to use in the initial phases. Overall, I would rate the solution an eight out of ten. 

View full review »
Lucas Dreyer - PeerSpot reviewer
Data Engineer at BBD

Training is quite important to get users up to scratch with Sparks SQL and Spark. Planning is needed in terms of training and skillsets. In terms of the typical DevOps MLOps deployment with pipelines, this training is particularly important. Otherwise you may end up with lots of functionality and queries that are difficult to change, deploy or maintain.

I would rate this solution an eight out of ten. In terms of scalability, it is very useful.

View full review »
Buyer's Guide
Spark SQL
March 2024
Learn what your peers think about Spark SQL. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
767,995 professionals have used our research since 2012.
Aria Amini - PeerSpot reviewer
Data Engineer at Behsazan Mellat

If the user data has a big volume of data, I think they should use PySpark, but for scenarios where they use a medium amount of data, they should not use PySpark because they have some overheads. I rate Spark SQL a nine out of ten.

View full review »
SB
CTO at Dokument IT d.o.o.

I recommend Spark SQL, but I will need to see what the results will be of our evaluation of Dremio. I'm especially expecting good performance because of the reflection mechanisms, which are actually materials used. But the open question is issues with the refresh rate. I don't know how bad or good that is.

I rate Spark SQL a ten out of ten with the correct implementation.

View full review »
Mahdi Sharifmousavi - PeerSpot reviewer
Lecturer at Amirkabir University of Technology

I recommend this solution. Spark provides good, clear documentation that is well organized. 

View full review »
KM
Senior Analyst/ Customer Business and Insights Specialist at a tech services company with 501-1,000 employees

The solution is very similar to the generic Spark and SQL language. 

I rate the solution an eight out of ten. 

View full review »
SS
Analytics and Reporting Manager at a financial services firm with 1,001-5,000 employees

We will have a lot of big data, which is why we need it. Otherwise, the solution is not needed. The solution really depends on the size of your data, its complexity, and the analysis that you are doing. Spark is good, but it is not mandatory.

Since I don't have experience in production with the solution, the best I can rate it now is a five (out of 10). 

View full review »
DM
Data Analytics Practice head at bse

We use both the on-premises and cloud deployment models.

We have a relationship with Cloudera and use their distribution channels. We don't have a relationship with Apache.

Spark SQL is a good product. However, users need to have the capability of implementing the correct tools and efficiencies.

I'd rate the solution seven out of ten.

View full review »
PK
Cloud Team Leader at TCL

I would rate Spark SQL a nine out of ten. 

My advice would be to read Databricks books about Spark. It's a good source of knowledge. 

In the next update, we'd like to see better performance for small points of data. It is possible but there are better tools that are faster and cheaper. 

View full review »
AG
Engineering Manager/Solution architect at a computer software company with 201-500 employees

I rate this solution an eight out of ten and would recommend it to others. 

View full review »
KG
Associate Manager at a consultancy with 501-1,000 employees

I rate Spark SQL a ten out of ten.

View full review »
QG
Corporate Sales at a financial services firm with 10,001+ employees

Being a new user, I would rate Spark SQL a four out of ten. 

View full review »
it_user986637 - PeerSpot reviewer
Project Manager - Senior Software Engineer at a tech services company with 11-50 employees

We've just started using this solution. We were using it until recently on a research basis, just to measure the performance, the cost, and so on and so forth. Many things could be improved, but are okay up till now, I'm happy with. I would recommend the product.

I would rate this solution eight out of ten.

View full review »
Buyer's Guide
Spark SQL
March 2024
Learn what your peers think about Spark SQL. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
767,995 professionals have used our research since 2012.