AWS Fargate vs Apache Spark comparison

Cancel
You must select at least 2 products to compare!
Apache Logo
2,793 views|2,165 comparisons
89% willing to recommend
Amazon Web Services (AWS) Logo
6,525 views|3,957 comparisons
100% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Apache Spark and AWS Fargate based on real PeerSpot user reviews.

Find out in this report how the two Compute Service solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed AWS Fargate vs. Apache Spark Report (Updated: May 2024).
772,679 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"It provides a scalable machine learning library.""It's easy to prepare parallelism in Spark, run the solution with specific parameters, and get good performance.""Provides a lot of good documentation compared to other solutions.""The good performance. The nice graphical management console. The long list of ML algorithms.""DataFrame: Spark SQL gives the leverage to create applications more easily and with less coding effort.""The main feature that we find valuable is that it is very fast.""The most valuable feature of this solution is its capacity for processing large amounts of data.""The product’s most valuable feature is the SQL tool. It enables us to create a database and publish it."

More Apache Spark Pros →

"We appreciate the simple use of containers within this solution, it makes managing the containers quick and easy.""Fargate itself is a stable product. We are quite satisfied with its performance.""The most valuable feature of Fargate is that it's self-managed. You don't have to configure your own clusters or deploy any Kubernetes clusters. This simplifies the initial deployment and scaling process.""AWS Fargate has many valuable services. It does the job with minimal trouble. It's very observable. You can see what's going on and you have logs. You have everything. You can troubleshoot it. It's affordable and it's flexible.""The most valuable feature of AWS Fargate is its ease of use.""If you create your deployment with a good set of rules for how to scale in, you can just set it and forget it.""I like their containerization service. You can use Docker or something similar and deploy quickly without the know-how related to, for example, Kubernetes. If you use AKS or Kubernetes, then you have to have the know-how. But for Fargate, you don't need to have the know-how there. You just deploy the container or the image, and then you have the container, and you can use it as AWS takes care of the rest. This makes it easier for those getting started or if you don't have a strong DevOps team inside your organization.""AWS Fargate is an easy-to-use tool to simplify setup. You only pay for the resources you use. If you need to quickly create, delete, or scale applications without managing resources like EC2 instances, Fargate is the best service to use."

More AWS Fargate Pros →

Cons
"If you have a Spark session in the background, sometimes it's very hard to kill these sessions because of D allocation.""The solution must improve its performance.""Needs to provide an internal schedule to schedule spark jobs with monitoring capability.""The migration of data between different versions could be improved.""Apache Spark could improve the connectors that it supports. There are a lot of open-source databases in the market. For example, cloud databases, such as Redshift, Snowflake, and Synapse. Apache Spark should have connectors present to connect to these databases. There are a lot of workarounds required to connect to those databases, but it should have inbuilt connectors.""When you are working with large, complex tasks, the garbage collection process is slow and affects performance.""They could improve the issues related to programming language for the platform.""The solution needs to optimize shuffling between workers."

More Apache Spark Cons →

"We faced challenges in vertically scaling our workload.""AWS Fargate could improve the privileged mode containers. We had some problems and they were not able to run.""I would like to see the older dashboard instead of the newer version. I don't like the new dashboard.""I heard from my team that it's not easy to predict the cost. That is the only issue we have with AWS Fargate, but I think that's acceptable. AWS Fargate isn't user-friendly. Anything related to Software as a Service or microservice architecture is not easy to implement. You're required to have DevOps from your side to implement the solution. AWS Fargate is just a temporary solution for us. When we grow to a certain level, we may use AKS for better control.""We would like to see some improvement in the process documents that are provided with this product, particularly for auto-scaling and other configuration tools that are a bit complicated.""If there are any options to manage containers, that would be good. That relates more to the cost point. For example, over the next three months, I'll be making a comparison between solutions like CAST AI and other software-as-a-service platforms that offer Kubernetes management with an emphasis on cost reduction.""The main area for improvement is the cost, which could be lowered to be more competitive with other major cloud providers."

More AWS Fargate Cons →

Pricing and Cost Advice
  • "Since we are using the Apache Spark version, not the data bricks version, it is an Apache license version, the support and resolution of the bug are actually late or delayed. The Apache license is free."
  • "Apache Spark is open-source. You have to pay only when you use any bundled product, such as Cloudera."
  • "We are using the free version of the solution."
  • "Apache Spark is not too cheap. You have to pay for hardware and Cloudera licenses. Of course, there is a solution with open source without Cloudera."
  • "Apache Spark is an expensive solution."
  • "Spark is an open-source solution, so there are no licensing costs."
  • "On the cloud model can be expensive as it requires substantial resources for implementation, covering on-premises hardware, memory, and licensing."
  • "It is an open-source solution, it is free of charge."
  • More Apache Spark Pricing and Cost Advice →

  • "I rate the price of AWS Fargate a four out of five."
  • "We would advise that this solution has a slightly-higher price point than others on the market. There is a free plan available for start-ups, but the free and lower range licensing models do not provide the full functionality."
  • More AWS Fargate Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Compute Service solutions are best for your needs.
    772,679 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:We use Spark to process data from different data sources.
    Top Answer:In data analysis, you need to take real-time data from different data sources. You need to process this in a subsecond, and do the transformation in a subsecond
    Top Answer:The most valuable feature of Fargate is that it's self-managed. You don't have to configure your own clusters or deploy any Kubernetes clusters. This simplifies the initial deployment and scaling… more »
    Top Answer:If there are any options to manage containers, that would be good. That relates more to the cost point. For example, over the next three months, I'll be making a comparison between solutions like CAST… more »
    Top Answer:The maturity you have in deploying serverless capabilities is crucial. For example, if your process takes less than 15 minutes, then you should consider AWS Lambda or other cloud function services. If… more »
    Ranking
    5th
    out of 16 in Compute Service
    Views
    2,793
    Comparisons
    2,165
    Reviews
    26
    Average Words per Review
    444
    Rating
    8.7
    6th
    out of 16 in Compute Service
    Views
    6,525
    Comparisons
    3,957
    Reviews
    6
    Average Words per Review
    506
    Rating
    8.5
    Comparisons
    Spring Boot logo
    Compared 31% of the time.
    AWS Batch logo
    Compared 10% of the time.
    Spark SQL logo
    Compared 9% of the time.
    SAP HANA logo
    Compared 8% of the time.
    Amazon Corretto logo
    Compared 2% of the time.
    Amazon EC2 logo
    Compared 24% of the time.
    AWS Batch logo
    Compared 8% of the time.
    AWS Lambda logo
    Compared 7% of the time.
    Apache NiFi logo
    Compared 4% of the time.
    Learn More
    Overview

    Spark provides programmers with an application programming interface centered on a data structure called the resilient distributed dataset (RDD), a read-only multiset of data items distributed over a cluster of machines, that is maintained in a fault-tolerant way. It was developed in response to limitations in the MapReduce cluster computing paradigm, which forces a particular linear dataflowstructure on distributed programs: MapReduce programs read input data from disk, map a function across the data, reduce the results of the map, and store reduction results on disk. Spark's RDDs function as a working set for distributed programs that offers a (deliberately) restricted form of distributed shared memory

    A new compute engine that enables you to use containers as a fundamental compute primitive without having to manage the underlying instances. With Fargate, you don’t need to provision, configure, or scale virtual machines in your clusters to run containers. Fargate can be used with Amazon ECS today, with plans to support Amazon Elastic Container Service for Kubernetes (Amazon EKS) in the future.

    Fargate has flexible configuration options so you can closely match your application needs and granular, per-second billing.

    Sample Customers
    NASA JPL, UC Berkeley AMPLab, Amazon, eBay, Yahoo!, UC Santa Cruz, TripAdvisor, Taboola, Agile Lab, Art.com, Baidu, Alibaba Taobao, EURECOM, Hitachi Solutions
    Expedia, Intuit, Royal Dutch Shell, Brooks Brothers
    Top Industries
    REVIEWERS
    Computer Software Company33%
    Financial Services Firm12%
    University9%
    Marketing Services Firm6%
    VISITORS READING REVIEWS
    Financial Services Firm25%
    Computer Software Company13%
    Manufacturing Company7%
    Comms Service Provider5%
    VISITORS READING REVIEWS
    Financial Services Firm26%
    Computer Software Company14%
    Manufacturing Company5%
    Government5%
    Company Size
    REVIEWERS
    Small Business42%
    Midsize Enterprise16%
    Large Enterprise42%
    VISITORS READING REVIEWS
    Small Business17%
    Midsize Enterprise12%
    Large Enterprise71%
    REVIEWERS
    Small Business44%
    Midsize Enterprise11%
    Large Enterprise44%
    VISITORS READING REVIEWS
    Small Business18%
    Midsize Enterprise12%
    Large Enterprise71%
    Buyer's Guide
    AWS Fargate vs. Apache Spark
    May 2024
    Find out what your peers are saying about AWS Fargate vs. Apache Spark and other solutions. Updated: May 2024.
    772,679 professionals have used our research since 2012.

    Apache Spark is ranked 5th in Compute Service with 60 reviews while AWS Fargate is ranked 6th in Compute Service with 8 reviews. Apache Spark is rated 8.4, while AWS Fargate is rated 8.6. The top reviewer of Apache Spark writes "Reliable, able to expand, and handle large amounts of data well". On the other hand, the top reviewer of AWS Fargate writes "Offers serverless capabilities, self-managed, simplifies ease of use and integrates with other AWS services". Apache Spark is most compared with Spring Boot, AWS Batch, Spark SQL, SAP HANA and Amazon Corretto, whereas AWS Fargate is most compared with Amazon EC2 Auto Scaling, Amazon EC2, AWS Batch, AWS Lambda and Apache NiFi. See our AWS Fargate vs. Apache Spark report.

    See our list of best Compute Service vendors.

    We monitor all Compute Service reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.