Spark SQL Scalability

Sahil Taneja - PeerSpot reviewer
Principal Consultant/Manager at Tenzing

There are around 30-40 users in our company using Spark SQL.

View full review »
Lucas Dreyer - PeerSpot reviewer
Data Engineer at BBD

I haven't had major issues with scaling very large datasets. I would rate it a nine out of ten for scalability. 

View full review »
Aria Amini - PeerSpot reviewer
Data Engineer at Behsazan Mellat

There are challenges to scalability with Spark SQL, but it is not too complex. Four users use Spark SQL professionally, but other developers use the solution in some minor cases. We are in the data engineering department, but our PI department also uses Spark SQL. Totally ten developers use Spark SQL in our organization.

View full review »
Buyer's Guide
Spark SQL
March 2024
Learn what your peers think about Spark SQL. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
767,847 professionals have used our research since 2012.
SB
CTO at Dokument IT d.o.o.

Spark SQL's scalability is excellent. In production, there will only be a few users who are analysts using statistical reports. Queries have many joints, and one query, on average, has seven to 12 joints. There are no plans to increase usage because I'm working on creating markets. There are higher management staff analysts for the data platform, and we have plans to expand the business with data platforms.

View full review »
Mahdi Sharifmousavi - PeerSpot reviewer
Lecturer at Amirkabir University of Technology

We only have 15 users but the solution is scalable. 

View full review »
KM
Senior Analyst/ Customer Business and Insights Specialist at a tech services company with 501-1,000 employees

The scalability depends on administrative rights. Every use case has certain allocated resources so a use case demanding scalability or extensive use can have additional resources allocated to it. 

View full review »
DM
Data Analytics Practice head at bse

The solution is scalable. We've found it easy to expand as necessary.

Right now, we have about 42 users on the solution. They include IT and ETL staff as well as a business analyst.

View full review »
PK
Cloud Team Leader at TCL

It is scalable. I use it on and off. I use it mostly daily. 

View full review »
AG
Engineering Manager/Solution architect at a computer software company with 201-500 employees

This solution is scalable. 

View full review »
KG
Associate Manager at a consultancy with 501-1,000 employees

I have found the solution to be scalable. We have 20 people using the solution in my organization and we plan to increase usage.

View full review »
QG
Corporate Sales at a financial services firm with 10,001+ employees

Its scalability is okay. We are a big organization. 

View full review »
it_user986637 - PeerSpot reviewer
Project Manager - Senior Software Engineer at a tech services company with 11-50 employees

The scalability of the solution is good.

View full review »
Buyer's Guide
Spark SQL
March 2024
Learn what your peers think about Spark SQL. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
767,847 professionals have used our research since 2012.