Apache Spark Stability

Ilya Afanasyev - PeerSpot reviewer
Senior Software Development Engineer at Yahoo!

The solution is stable. There are no bugs or glitches. It doesn't crash or freeze. 

View full review »
SS
Sr Manager at a transportation company with 10,001+ employees

It is a stable solution, but when it comes to patch updates and different reports being updated, it can be a headache. 

When an application is built on top of certain reports with specific versions, and then the version changes, it can lead to a lot of things needing to be adjusted. This is something that definitely needs improvement.

View full review »
Suriya Senthilkumar - PeerSpot reviewer
Analyst at Deloitte

The platform’s stability depends on how effectively we write the code. We encountered a few issues related to programming languages.

View full review »
Buyer's Guide
Apache Spark
April 2024
Learn what your peers think about Apache Spark. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
768,415 professionals have used our research since 2012.
Miodrag Milojevic - PeerSpot reviewer
Senior Data Archirect at Yettel

The solution is stable, but not completely. For example, we use Exadata as an extremely stable data warehouse, but that's not possible with big data. There are things that you have to fix sometimes. The stability is similar to the cloud solution, but that depends on the solution you need.

View full review »
Hamid M. Hamid - PeerSpot reviewer
Data architect at Banking Sector

Stability-wise, I rate the solution a nine out of ten.

View full review »
Lucas Dreyer - PeerSpot reviewer
Data Engineer at BBD

I have not encountered any significant stability issues and it has proven to be a robust and reliable platform without major crashes. However, there have been instances where I needed to address query optimization and similar tasks to ensure optimal performance. I would rate it nine out of ten.

View full review »
Atal Upadhyay - PeerSpot reviewer
AVP at MIDDAY INFOMEDIA LIMITED

It offers a high level of stability. I would rate it nine out of ten.

View full review »
Anshuman Kishore - PeerSpot reviewer
Director Product Development at Mycom Osi

Stability-wise, I rate the solution an eight and a half out of ten.

View full review »
VM
Cloud solution architect at 0

The solution was definitely stable. There were no unstable services in it. Since most services were in Azure, everything worked better. 

Azure's networking products, like ExpressRoute and Private Link service, are very stable. We didn't encounter any issues with the solution. 

It took some time to complete, but after that, we haven't had a single support case.

View full review »
AmitMataghare - PeerSpot reviewer
Associate Director at a consultancy with 10,001+ employees

Apache Spark is stable.

View full review »
Atif Tariq - PeerSpot reviewer
Cloud and Big Data Engineer | Developer at Huawei Cloud Middle East

Apache Spark is a very stable solution. The community is still working on other parts, like performance and removing bottlenecks. However, from a stipulative point of view, the solution's stability is very good.

I rate Apache Spark a nine out of ten for stability.

View full review »
Lokesh Jayanna - PeerSpot reviewer
Vice President at Goldman Sachs at a computer software company with 10,001+ employees

It is a stable product. I rate its stability an eight out of ten.

View full review »
UjjwalGupta - PeerSpot reviewer
Module Lead at Mphasis

Apache Spark is generally considered a stable product, with rare instances of breaking down. Issues may arise in sudden increases in data volume, leading to memory errors, but these can typically be managed with autoscaling clusters. Additionally, schema changes or irregularities in streaming data may pose challenges, but these could be addressed in future software versions.

View full review »
ML
Information Technology Business Analyst at a aerospace/defense firm with 10,001+ employees

The tool is stable. I rate the stability a ten out of ten.

View full review »
Oscar Estorach - PeerSpot reviewer
Chief Data-strategist and Director at Theworkshop.es

The stability is very good. There are no bugs or glitches and it doesn't crash or freeze. It's a reliable solution. 

View full review »
Armando Becerril - PeerSpot reviewer
Partner / Head of Data & Analytics at Kueski

The solution is stable. 

View full review »
KK
Software Architect at Akbank

It is the most stable platform. As compare to Flink, Spark is good, especially in terms of clusters and architecture. My colleagues who set up these clusters say that Spark is the easiest.

View full review »
Suresh_Srinivasan - PeerSpot reviewer
Co-Founder at FORMCEPT Technologies

It is a stable solution. The solution is ten out of ten on stability. 

View full review »
SB
CTO at Hammerknife

I rate the product's stability a ten out of ten.

View full review »
MA
PLC Programmer at Alzero

The solution is highly stable. I rate it a perfect ten.


View full review »
FK
Data Engineer at Berief Food GmbH

The tool is stable. I rate the stability more than nine out of ten.

View full review »
JK
Quantitative Developer at a marketing services firm with 11-50 employees

I haven't faced any stability issues. It has been stable in my experience.

View full review »
Mahdi Sharifmousavi - PeerSpot reviewer
Lecturer at Amirkabir University of Technology

We have found this solution to be stable during our time using it.

View full review »
Suresh_Srinivasan - PeerSpot reviewer
Co-Founder at FORMCEPT Technologies

The solution is stable.

View full review »
Suresh_Srinivasan - PeerSpot reviewer
Co-Founder at FORMCEPT Technologies

We haven't had any issues with stability so far. 

View full review »
NB
CEO International Business at a tech services company with 1,001-5,000 employees

It provides excellent stability. We never faced any issues with it.

View full review »
it_user365304 - PeerSpot reviewer
Software Consultant at a tech services company with 10,001+ employees

See above regarding memory usage.

View full review »
it_user371832 - PeerSpot reviewer
Chief System Architect at a marketing services firm with 501-1,000 employees

Spark Streaming is difficult to stabilize as you're always dependant to your stream flow. If you start to be late on the consumer you've a serious problem. We've encountered a lot of stability issue to configure it as expected

View full review »
Onur Tokat - PeerSpot reviewer
Big Data Engineer Consultant at Collective[i]

Generally, Spark works correctly without any errors. It may give out some errors if your data changes, but in that case, it's a problem with the configuration, not with Spark.

View full review »
RV
Director at Nihil Solutions

The stability of the solution is very, very good. It doesn't crash or have glitches. It's quite reliable for us.

View full review »
SA
Technical Consultant at a tech services company with 1-10 employees

In terms of stability, I have not seen any bugs, glitches or crashes. Even if there is, that's fine, because I would probably take care of it and then I'd have progressed further in the process.

View full review »
it_user786777 - PeerSpot reviewer
Manager | Data Science Enthusiast | Management Consultant at a consultancy with 5,001-10,000 employees

At times when users do not know how to use Spark and request a lot of resources, then the underlying JVMs can crash, which is a big sense of worry. 

View full review »
NK
Director of Enginnering at Sigmoid

There were bugs three to four years ago, which have been resolved. There were a couple of issues related to slowness when we did a lot of transformations using the Width columns. I was writing a POC on ETL for moving from Informatica to Spark SQL for the ETL pipeline. It required the use of hundreds of Width columns to change the column name or add some transformation, which made it slow. It happened in versions prior to version 1.6, and it seems that this issue has been fixed later on.

View full review »
it_user946074 - PeerSpot reviewer
Principal Architect at a financial services firm with 1,001-5,000 employees

I found the solution stable. We haven't had any problems with it.

View full review »
AR
Manager - Data Science Competency at a tech services company with 201-500 employees

This product is pretty stable. Companies like Facebook, Uber, and Netflix are all using Apache Spark. It's stable enough to be used all over the world.

View full review »
it_user372393 - PeerSpot reviewer
Big Data Consultant at a tech services company with 501-1,000 employees

In the past we deployed Spark 1.3 to use Spark SQL but unfortunately one of our queries failed because of a bug fixed in following releases. Then we moved to Spark 1.6 but still some queries were failing when run against huge datasets. Now we are using version 2.1: it is more stable, it ensures better performances and the SQL/ML parts are reacher than before.

View full review »
it_user74256 - PeerSpot reviewer
Engineer at a tech vendor with 10,001+ employees

We met some standalone deployment issues, which showed that its stability is not that good. So we plan to switch to Yarn or Mesos mode

View full review »
it_user746943 - PeerSpot reviewer
Big Data and Cloud Solution Consultant at a financial services firm with 10,001+ employees
it_user373173 - PeerSpot reviewer
Lead Big Data Engineer at a non-profit with 51-200 employees

I ran into Spark application performance issues. For instance, Spark JDBC write performance needs to be improved.

View full review »
it_user371334 - PeerSpot reviewer
CEO at a tech consulting company with 51-200 employees

It's been stable for us.

View full review »
AD
Senior Consultant & Training at a tech services company with 51-200 employees

This solution is difficult for users who are just beginning and they experience out of memory errors when dealing with large amounts of data.

View full review »
it_user326142 - PeerSpot reviewer
Architect at a healthcare company with 51-200 employees

Yes, occasionally with different APIs.

View full review »
SK
Chief Technology Officer at a tech services company with 11-50 employees

Apache Spark is stable.

View full review »
it_user374028 - PeerSpot reviewer
Core Engine Engineer at a computer software company with 51-200 employees

There have been no issues with the stability.

View full review »
MG
Director of BigData Offer at IVIDATA

The solution is very stable.

View full review »
it_user746673 - PeerSpot reviewer
Sr. Software Engineer at a tech vendor with 1-10 employees

No, I did not encounter any problems with the stability. It is also quite backwards compatible.

View full review »
it_user371325 - PeerSpot reviewer
Data Scientist at a tech vendor with 10,001+ employees

There have been no stability issues.

View full review »
LC
Snr Security Engineer at a tech vendor with 201-500 employees

The 2.3 version is quite stable. All of our customers use it, there are around 100,000+ users, and it runs 24/7.

View full review »
it_user1223676 - PeerSpot reviewer
Lead Consultant at a tech services company with 51-200 employees

We don't have any problems with stability. 

View full review »
Buyer's Guide
Apache Spark
April 2024
Learn what your peers think about Apache Spark. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
768,415 professionals have used our research since 2012.