Apache Spark Scalability
The product scales well. It's fine to expand if needed.
Many teams use Spark. For example, we have a few kinds of pipelines, huge pipelines. One of them processes 300 billion events each day. It's our core technology currently.
We do not plan to increase usage. We keep our legacy system on Spark, and we are now discussing Flink and Spark and what we would prefer. However, most of the people are already migrating new systems to Flink. We will keep Spark for a few more years still.
View full review »We have more than 100 Apache Spark users in our organization.
View full review »The solution is scalable, but adding new nodes is not easy. It will take some time to do that, but it's scalable. We have about 20 users using Apache Spark. We regularly use the solution.
View full review »Buyer's Guide
Apache Spark
April 2024
Learn what your peers think about Apache Spark. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
767,847 professionals have used our research since 2012.
It is a very scalable solution. Scalability-wise, I rate the solution a nine out of ten.
There are no different numbers of uses for Apache Spark in my company since it is used as a processing engine.
It serves as a data node, making it highly scalable. It caters to a user base of around five thousand or so.
View full review »It is a very scalable solution.
In our company, there are users of Apache Spark, and then there are users of the applications that were developed with it.
Currently, my company does not plan to increase the use of the product.
VM
Vineeth Marar
Cloud solution architect at 0
The solution is scalable. We used a load balancer at each tier, with multiple instances of the services running.
It's all scalable and relevant. We didn't have a lot of issues and have been monitoring the traffic flow.
We even projected the requests for the next two to three years and created scalable instances accordingly.
There are many users of Spark in our organization. For example, many customers are using Spark, often in conjunction with requests from third-party vendors. They frequently use Spark plug-ins as well.
I have found Apache Spark to be scalable.
View full review »Apache Spark is a scalable solution. More than 50 to 100 users are using the solution in our organization.
View full review »We have 45 Apache Spark users. I rate its scalability a nine out of ten.
View full review »About 70-80 percent of employees in my company use the product.
View full review »ML
reviewer1759647
Information Technology Business Analyst at a aerospace/defense firm with 10,001+ employees
The tool is very scalable. I rate the scalability a ten out of ten. Approximately 30 users are using Apache Spark in our organization.
View full review »We have found the scalability to be good. If your company needs to expand it, it can do so.
We have five people working on the solution currently.
View full review »The solution is scalable.
View full review »KK
Kürşat Kurt
Software Architect at Akbank
It is scalable, but we don't have the need to scale it.
It is mainly used for reporting big data in our organization. All teams, especially the VR team, are using Spark for job execution and remote execution. I can say that 70% of users use Spark for reporting, calculations, and real-time operations. We are a very big company, and we have around a thousand people in IT.
We will continue its usage and develop more. We have kind of just started using it. We finished this project just three months ago. We are now trying to find out bottlenecks in our systems, and then we are ready to go.
View full review »The solution is highly scalable. All of the technical guys use Spark. Our product is used by many people within our customers' company.
View full review »SB
SlavenBatnozic
CTO at Hammerknife
The product is enormously scalable.
View full review »MA
Marco Amhof
PLC Programmer at Alzero
Around 15 data scientists are using Apache Spark in our organization.
View full review »FK
Farzam Khodaei
Data Engineer at Berief Food GmbH
We have a small business. Around four people in my organization use the solution.
View full review »JK
reviewer2208003
Quantitative Developer at a marketing services firm with 11-50 employees
When it comes to the scalability of Spark, it's primarily a processing engine, not a database engine. I haven't tested it extensively with large record sizes.
In my organization, quite a few people are using Spark. In my smaller team, there are only two users.
View full review »This is a very scalable solution from our experience.
View full review »Apache Spark is scalable. However, it needs enormous technical skills to make it scalable. It is not a simple task.
We have approximately 20 people using this solution.
View full review »As long as you do it correctly, it is scalable.
Our users mostly consist of data analysts, engineers, data scientists, and DB admins.
View full review »NB
reviewer1283880
CEO International Business at a tech services company with 1,001-5,000 employees
It ensures outstanding scalability capabilities.
View full review »We've had no issues with scalability.
View full review »It's linked to stability in our case it's takes time to evaluate what is the correct size of the cluster you need. It's very important to always add to you jobs monitoring to be able to understand what's the problem. We use datadog as monitoring platform
View full review »The cloud version of Spark is very easy to scale.
View full review »RV
Rajendran Veerappan
Director at Nihil Solutions
The scalability of the solution is very good. If a company has to expand it, they can do so.
Right now, we have about six or seven users that are directly on the product. We're encouraging them to use more data. We do plan to increase usage in the future.
View full review »SA
reviewer879201
Technical Consultant at a tech services company with 1-10 employees
I have not tested the scalability yet.
In my company, there are two or three people that are using it for different products. But right now, the client I'm engaged with doesn't know anything about Spark or Hadoop. They are a typical financial company so they do what they do, and they ask us to do everything. They have pretty much outsourced their whole big data initiative to us.
View full review »No issues.
View full review »NK
NitinKumar
Director of Enginnering at Sigmoid
It is very scalable. You can scale it a lot.
View full review »PE
reviewer1792824
Senior Test Automation Consultant / Architect at a tech services company with 11-50 employees
It is not scalable. Scalability is one of the issues.
View full review »AR
reviewer1185906
Manager - Data Science Competency at a tech services company with 201-500 employees
In our team that works on this, we have approximately 10 people.
View full review »I've had no issues with the scalability.
View full review »There were no issues with the scalability.
View full review »It's scaled without issue.
View full review »SK
reviewer1904019
Chief Technology Officer at a tech services company with 11-50 employees
We are using Apache Spark across multiple nodes and it is scalable.
We have approximately five people using this solution.
View full review »There have been no issues with the scalability.
View full review »MG
Mohamed Ghorbel
Director of BigData Offer at IVIDATA
The solution is scalable. My understanding is version 3.0 has renewed scaling capabilities and will be able to do so automatically.
View full review »No I did not as of now, it is quite scalable. Using simple scripts you can add as many workers as you want.
View full review »I haven't had any scalability issues. It scales better than Python and R.
View full review »LC
Snrsecengin567
Snr Security Engineer at a tech vendor with 201-500 employees
The scalability is very good.
View full review »Buyer's Guide
Apache Spark
April 2024
Learn what your peers think about Apache Spark. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
767,847 professionals have used our research since 2012.